Apr 17 10:27:57 user devstack@n-api.service[72742]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 17 10:27:57 user devstack@n-api.service[72742]: *** Starting uWSGI 2.0.20-debian (64bit) on [Mon Apr 17 10:27:57 2023] *** Apr 17 10:27:57 user devstack@n-api.service[72742]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 17 10:27:57 user devstack@n-api.service[72742]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 17 10:27:57 user devstack@n-api.service[72742]: nodename: user Apr 17 10:27:57 user devstack@n-api.service[72742]: machine: x86_64 Apr 17 10:27:57 user devstack@n-api.service[72742]: clock source: unix Apr 17 10:27:57 user devstack@n-api.service[72742]: pcre jit disabled Apr 17 10:27:57 user devstack@n-api.service[72742]: detected number of CPU cores: 12 Apr 17 10:27:57 user devstack@n-api.service[72742]: current working directory: / Apr 17 10:27:57 user devstack@n-api.service[72742]: detected binary path: /usr/bin/uwsgi-core Apr 17 10:27:57 user devstack@n-api.service[72742]: your processes number limit is 63637 Apr 17 10:27:57 user devstack@n-api.service[72742]: your memory page size is 4096 bytes Apr 17 10:27:57 user devstack@n-api.service[72742]: detected max file descriptor number: 2048 Apr 17 10:27:57 user devstack@n-api.service[72742]: lock engine: pthread robust mutexes Apr 17 10:27:57 user devstack@n-api.service[72742]: thunder lock: enabled Apr 17 10:27:57 user devstack@n-api.service[72742]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 17 10:27:57 user devstack@n-api.service[72742]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 17 10:27:57 user devstack@n-api.service[72742]: Python main interpreter initialized at 0x5564310e4990 Apr 17 10:27:57 user devstack@n-api.service[72742]: python threads support enabled Apr 17 10:27:57 user devstack@n-api.service[72742]: your server socket listen backlog is limited to 100 connections Apr 17 10:27:57 user devstack@n-api.service[72742]: your mercy for graceful operations on workers is 90 seconds Apr 17 10:27:57 user devstack@n-api.service[72742]: mapped 537436 bytes (524 KB) for 3 cores Apr 17 10:27:57 user devstack@n-api.service[72742]: *** Operational MODE: preforking *** Apr 17 10:27:57 user devstack@n-api.service[72742]: *** uWSGI is running in multiple interpreter mode *** Apr 17 10:27:57 user devstack@n-api.service[72742]: spawned uWSGI master process (pid: 72742) Apr 17 10:27:57 user devstack@n-api.service[72742]: spawned uWSGI worker 1 (pid: 72743, cores: 1) Apr 17 10:27:57 user devstack@n-api.service[72742]: spawned uWSGI worker 2 (pid: 72744, cores: 1) Apr 17 10:27:57 user devstack@n-api.service[72742]: spawned uWSGI worker 3 (pid: 72745, cores: 1) Apr 17 10:27:57 user devstack@n-api.service[72742]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 17 10:27:57 user devstack@n-api.service[72745]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 17 10:27:57 user devstack@n-api.service[72743]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 17 10:27:58 user devstack@n-api.service[72744]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 17 10:28:01 user devstack@n-api.service[72745]: live_migration_uri is deprecated for removal in favor of two other options that Apr 17 10:28:01 user devstack@n-api.service[72745]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 17 10:28:01 user devstack@n-api.service[72745]: and ``live_migration_inbound_addr`` respectively. Apr 17 10:28:01 user devstack@n-api.service[72745]: ). Its value may be silently ignored in the future. Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 17 10:28:01 user devstack@n-api.service[72743]: live_migration_uri is deprecated for removal in favor of two other options that Apr 17 10:28:01 user devstack@n-api.service[72743]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 17 10:28:01 user devstack@n-api.service[72743]: and ``live_migration_inbound_addr`` respectively. Apr 17 10:28:01 user devstack@n-api.service[72743]: ). Its value may be silently ignored in the future. Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72745) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72743) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 17 10:28:01 user devstack@n-api.service[72744]: live_migration_uri is deprecated for removal in favor of two other options that Apr 17 10:28:01 user devstack@n-api.service[72744]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 17 10:28:01 user devstack@n-api.service[72744]: and ``live_migration_inbound_addr`` respectively. Apr 17 10:28:01 user devstack@n-api.service[72744]: ). Its value may be silently ignored in the future. Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: INFO dbcounter [None req-05f31de0-77b4-4b71-9b0a-5ea928205e5f None None] Registered counter for database nova_api Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: INFO dbcounter [None req-e3c3d58e-e618-41ec-bd81-7c43063e0de5 None None] Registered counter for database nova_api Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG oslo_db.sqlalchemy.engines [None req-05f31de0-77b4-4b71-9b0a-5ea928205e5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72745) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writer thread running {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG oslo_db.sqlalchemy.engines [None req-e3c3d58e-e618-41ec-bd81-7c43063e0de5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72743) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writer thread running {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72744) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG nova.context [None req-05f31de0-77b4-4b71-9b0a-5ea928205e5f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ffc8026a-7976-4201-8419-273e745bfd05(cell1) {{(pid=72745) load_cells /opt/stack/nova/nova/context.py:464}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-05f31de0-77b4-4b71-9b0a-5ea928205e5f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-05f31de0-77b4-4b71-9b0a-5ea928205e5f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-05f31de0-77b4-4b71-9b0a-5ea928205e5f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-05f31de0-77b4-4b71-9b0a-5ea928205e5f None None] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-05f31de0-77b4-4b71-9b0a-5ea928205e5f None None] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-05f31de0-77b4-4b71-9b0a-5ea928205e5f None None] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:28:01 user devstack@n-api.service[72745]: INFO dbcounter [None req-05f31de0-77b4-4b71-9b0a-5ea928205e5f None None] Registered counter for database nova_cell0 Apr 17 10:28:01 user devstack@n-api.service[72745]: INFO dbcounter [None req-05f31de0-77b4-4b71-9b0a-5ea928205e5f None None] Registered counter for database nova_cell1 Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG oslo_db.sqlalchemy.engines [None req-05f31de0-77b4-4b71-9b0a-5ea928205e5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72745) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG oslo_db.sqlalchemy.engines [None req-05f31de0-77b4-4b71-9b0a-5ea928205e5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72745) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writer thread running {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writer thread running {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG nova.context [None req-e3c3d58e-e618-41ec-bd81-7c43063e0de5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ffc8026a-7976-4201-8419-273e745bfd05(cell1) {{(pid=72743) load_cells /opt/stack/nova/nova/context.py:464}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e3c3d58e-e618-41ec-bd81-7c43063e0de5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e3c3d58e-e618-41ec-bd81-7c43063e0de5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e3c3d58e-e618-41ec-bd81-7c43063e0de5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e3c3d58e-e618-41ec-bd81-7c43063e0de5 None None] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e3c3d58e-e618-41ec-bd81-7c43063e0de5 None None] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e3c3d58e-e618-41ec-bd81-7c43063e0de5 None None] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:28:01 user devstack@n-api.service[72743]: INFO dbcounter [None req-e3c3d58e-e618-41ec-bd81-7c43063e0de5 None None] Registered counter for database nova_cell0 Apr 17 10:28:01 user devstack@n-api.service[72743]: INFO dbcounter [None req-e3c3d58e-e618-41ec-bd81-7c43063e0de5 None None] Registered counter for database nova_cell1 Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG oslo_db.sqlalchemy.engines [None req-e3c3d58e-e618-41ec-bd81-7c43063e0de5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72743) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writer thread running {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG oslo_db.sqlalchemy.engines [None req-e3c3d58e-e618-41ec-bd81-7c43063e0de5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72743) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 10:28:01 user devstack@n-api.service[72744]: INFO dbcounter [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] Registered counter for database nova_api Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG oslo_db.sqlalchemy.engines [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72744) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writer thread running {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 17 10:28:01 user devstack@n-api.service[72745]: INFO dbcounter [None req-05f31de0-77b4-4b71-9b0a-5ea928205e5f None None] Registered counter for database nova_cell0 Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG oslo_db.sqlalchemy.engines [None req-05f31de0-77b4-4b71-9b0a-5ea928205e5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72745) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG nova.context [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ffc8026a-7976-4201-8419-273e745bfd05(cell1) {{(pid=72744) load_cells /opt/stack/nova/nova/context.py:464}} Apr 17 10:28:01 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writer thread running {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:28:01 user devstack@n-api.service[72744]: INFO dbcounter [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] Registered counter for database nova_cell0 Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writer thread running {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 17 10:28:01 user devstack@n-api.service[72744]: INFO dbcounter [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] Registered counter for database nova_cell1 Apr 17 10:28:01 user devstack@n-api.service[72743]: INFO dbcounter [None req-e3c3d58e-e618-41ec-bd81-7c43063e0de5 None None] Registered counter for database nova_cell0 Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG oslo_db.sqlalchemy.engines [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72744) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writer thread running {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG oslo_db.sqlalchemy.engines [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72744) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG oslo_db.sqlalchemy.engines [None req-e3c3d58e-e618-41ec-bd81-7c43063e0de5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72743) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 10:28:01 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writer thread running {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writer thread running {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 17 10:28:01 user devstack@n-api.service[72744]: INFO dbcounter [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] Registered counter for database nova_cell0 Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG oslo_db.sqlalchemy.engines [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72744) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 10:28:01 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writer thread running {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 17 10:28:02 user devstack@n-api.service[72745]: WARNING keystonemiddleware.auth_token [None req-05f31de0-77b4-4b71-9b0a-5ea928205e5f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 17 10:28:02 user devstack@n-api.service[72745]: WARNING keystonemiddleware.auth_token [None req-05f31de0-77b4-4b71-9b0a-5ea928205e5f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 17 10:28:02 user devstack@n-api.service[72743]: WARNING keystonemiddleware.auth_token [None req-e3c3d58e-e618-41ec-bd81-7c43063e0de5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 17 10:28:02 user devstack@n-api.service[72743]: WARNING keystonemiddleware.auth_token [None req-e3c3d58e-e618-41ec-bd81-7c43063e0de5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 17 10:28:02 user devstack@n-api.service[72745]: WARNING keystonemiddleware.auth_token [None req-05f31de0-77b4-4b71-9b0a-5ea928205e5f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 17 10:28:02 user devstack@n-api.service[72745]: WARNING keystonemiddleware.auth_token [None req-05f31de0-77b4-4b71-9b0a-5ea928205e5f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 17 10:28:02 user devstack@n-api.service[72745]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5564310e4990 pid: 72745 (default app) Apr 17 10:28:02 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-05f31de0-77b4-4b71-9b0a-5ea928205e5f None None] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:28:02 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-05f31de0-77b4-4b71-9b0a-5ea928205e5f None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.002845 Apr 17 10:28:02 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Mon Apr 17 10:28:02 2023] GET /compute/v2.1/ => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:28:02 user devstack@n-api.service[72744]: WARNING keystonemiddleware.auth_token [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 17 10:28:02 user devstack@n-api.service[72744]: WARNING keystonemiddleware.auth_token [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 17 10:28:02 user devstack@n-api.service[72743]: WARNING keystonemiddleware.auth_token [None req-e3c3d58e-e618-41ec-bd81-7c43063e0de5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 17 10:28:02 user devstack@n-api.service[72743]: WARNING keystonemiddleware.auth_token [None req-e3c3d58e-e618-41ec-bd81-7c43063e0de5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 17 10:28:02 user devstack@n-api.service[72743]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5564310e4990 pid: 72743 (default app) Apr 17 10:28:02 user devstack@n-api.service[72744]: WARNING keystonemiddleware.auth_token [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 17 10:28:02 user devstack@n-api.service[72744]: WARNING keystonemiddleware.auth_token [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 17 10:28:02 user devstack@n-api.service[72744]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5564310e4990 pid: 72744 (default app) Apr 17 10:30:11 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-05f31de0-77b4-4b71-9b0a-5ea928205e5f None None] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:30:11 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-05f31de0-77b4-4b71-9b0a-5ea928205e5f None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002154 Apr 17 10:30:11 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 17 10:30:11 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:30:11 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=3 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:30:11 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=3 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:30:11 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=3 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:30:11 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=3 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:30:11 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-c8148e66-19d0-4503-b950-5daa35b8998b admin admin] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:30:11 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-c8148e66-19d0-4503-b950-5daa35b8998b admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.381526 Apr 17 10:30:11 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Mon Apr 17 10:30:11 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:30:13 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:30:13 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002126 Apr 17 10:30:13 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 17 10:30:13 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:30:13 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=3 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:30:13 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=3 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:30:13 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=3 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:30:13 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:30:13 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-8a07b503-94b4-4665-af07-b99f6d53cd66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "rxtx_factor": 1.0, "disk": 1, "name": "cirros256", "swap": 0, "os-flavor-access:is_public": true, "ram": 256, "vcpus": 1}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:30:13 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-8a07b503-94b4-4665-af07-b99f6d53cd66 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.329031 Apr 17 10:30:13 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 17 10:30:13 2023] POST /compute/v2.1/flavors => generated 405 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 10:30:13 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-fbcc9b36-53dc-4e7a-9ae8-8b653c0912db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:30:13 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-fbcc9b36-53dc-4e7a-9ae8-8b653c0912db admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049872 Apr 17 10:30:13 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Mon Apr 17 10:30:13 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:30:15 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:30:15 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002090 Apr 17 10:30:15 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 17 10:30:15 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:30:15 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-763e080c-62cc-4fb8-94a6-b0821bd4e6b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 5, "vcpus": 1, "ram": 512, "id": "d1"}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:30:15 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-763e080c-62cc-4fb8-94a6-b0821bd4e6b8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.065099 Apr 17 10:30:15 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 17 10:30:15 2023] POST /compute/v2.1/flavors => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 10:30:15 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-fb812584-648f-44e1-b5a1-a8ca8cad6f3d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:30:15 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-fb812584-648f-44e1-b5a1-a8ca8cad6f3d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024680 Apr 17 10:30:15 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Mon Apr 17 10:30:15 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:30:17 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:30:17 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001510 Apr 17 10:30:17 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 17 10:30:17 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:30:17 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-a0d3889e-c53b-455c-acee-090dfd334b1a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "ram": 1024, "id": "d2", "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "vcpus": 1}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:30:17 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-a0d3889e-c53b-455c-acee-090dfd334b1a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.067628 Apr 17 10:30:17 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 17 10:30:17 2023] POST /compute/v2.1/flavors => generated 402 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 10:30:17 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-58e8007e-9f86-447c-8d68-a5102271357d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:30:17 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-58e8007e-9f86-447c-8d68-a5102271357d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029867 Apr 17 10:30:17 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Mon Apr 17 10:30:17 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:30:19 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:30:19 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001443 Apr 17 10:30:19 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 17 10:30:19 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 10:30:19 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-b612b0b7-9c5b-49a5-ba22-4d8dd566780c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "id": "d3", "name": "ds2G", "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:30:19 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-b612b0b7-9c5b-49a5-ba22-4d8dd566780c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.067045 Apr 17 10:30:19 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 17 10:30:19 2023] POST /compute/v2.1/flavors => generated 402 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 10:30:19 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-55186e00-bdce-465f-95c6-e53ce6070782 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:30:19 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-55186e00-bdce-465f-95c6-e53ce6070782 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025135 Apr 17 10:30:19 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Mon Apr 17 10:30:19 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:30:21 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:30:21 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002037 Apr 17 10:30:21 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 17 10:30:21 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:30:21 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-bbce6925-f573-45f5-b928-f2d376c3d06b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "os-flavor-access:is_public": true, "name": "ds4G", "vcpus": 4, "ram": 4096, "swap": 0, "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:30:21 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-bbce6925-f573-45f5-b928-f2d376c3d06b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.062205 Apr 17 10:30:21 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 17 10:30:21 2023] POST /compute/v2.1/flavors => generated 402 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 10:30:21 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-56b6d115-0720-458e-8f51-3391d0eb9deb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:30:21 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-56b6d115-0720-458e-8f51-3391d0eb9deb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024899 Apr 17 10:30:21 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Mon Apr 17 10:30:21 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:30:23 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:30:23 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-06646029-dc7b-4f4f-b7db-dab4981e0f45 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001369 Apr 17 10:30:23 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 17 10:30:23 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:30:23 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-984d5a58-4e83-44f2-a132-4b1ca0b81559 admin admin] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:30:23 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-984d5a58-4e83-44f2-a132-4b1ca0b81559 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.068814 Apr 17 10:30:23 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Mon Apr 17 10:30:23 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:30:25 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-56b6d115-0720-458e-8f51-3391d0eb9deb admin admin] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:30:25 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-56b6d115-0720-458e-8f51-3391d0eb9deb admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001638 Apr 17 10:30:25 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 17 10:30:25 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:30:25 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=3 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:30:25 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=3 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:30:25 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=3 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:30:25 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=3 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:30:25 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-88a7c2fd-213a-4857-9753-28606506acab admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "name": "m1.tiny", "id": "1", "rxtx_factor": 1.0}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:30:25 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-88a7c2fd-213a-4857-9753-28606506acab admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.375399 Apr 17 10:30:25 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 17 10:30:25 2023] POST /compute/v2.1/flavors => generated 400 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 10:30:25 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-8cb77181-7b73-4fce-8b2e-d14315f68ed8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:30:26 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-8cb77181-7b73-4fce-8b2e-d14315f68ed8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039648 Apr 17 10:30:26 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Mon Apr 17 10:30:25 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:30:28 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-56b6d115-0720-458e-8f51-3391d0eb9deb admin admin] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:30:28 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-56b6d115-0720-458e-8f51-3391d0eb9deb admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001550 Apr 17 10:30:28 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 17 10:30:28 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:30:28 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-bf35221a-c2c7-401e-8d71-b4c8d9da7616 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 2048, "disk": 20, "id": "2", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small"}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:30:28 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-bf35221a-c2c7-401e-8d71-b4c8d9da7616 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.061599 Apr 17 10:30:28 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 17 10:30:28 2023] POST /compute/v2.1/flavors => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 10:30:28 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-d0cb2b3e-0473-4bf7-b03a-3737ceada8d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:30:28 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-d0cb2b3e-0473-4bf7-b03a-3737ceada8d5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030032 Apr 17 10:30:28 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Mon Apr 17 10:30:28 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:30:30 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-56b6d115-0720-458e-8f51-3391d0eb9deb admin admin] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:30:30 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-56b6d115-0720-458e-8f51-3391d0eb9deb admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001698 Apr 17 10:30:30 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 17 10:30:30 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:30:30 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-93a2d69a-d0c5-4273-b53d-52a156bcf71c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.medium", "ram": 4096, "vcpus": 2, "rxtx_factor": 1.0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 40}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:30:30 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-93a2d69a-d0c5-4273-b53d-52a156bcf71c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.067409 Apr 17 10:30:30 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 17 10:30:30 2023] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 10:30:30 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-aa24afea-0964-4335-b7f0-cfc6a09741f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:30:30 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-aa24afea-0964-4335-b7f0-cfc6a09741f8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025844 Apr 17 10:30:30 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Mon Apr 17 10:30:30 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:30:32 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-56b6d115-0720-458e-8f51-3391d0eb9deb admin admin] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:30:32 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-56b6d115-0720-458e-8f51-3391d0eb9deb admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001352 Apr 17 10:30:32 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 17 10:30:32 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:30:32 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-61517a9f-6651-44ff-917b-a911e29c074e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "os-flavor-access:is_public": true, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "rxtx_factor": 1.0, "disk": 80, "swap": 0, "vcpus": 4}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:30:32 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-61517a9f-6651-44ff-917b-a911e29c074e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.068260 Apr 17 10:30:32 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 17 10:30:32 2023] POST /compute/v2.1/flavors => generated 403 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 10:30:32 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-ac7f8cab-42c7-4077-a15a-bb3318a9fec4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:30:32 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-ac7f8cab-42c7-4077-a15a-bb3318a9fec4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024362 Apr 17 10:30:32 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Mon Apr 17 10:30:32 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:30:34 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-56b6d115-0720-458e-8f51-3391d0eb9deb admin admin] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:30:34 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-56b6d115-0720-458e-8f51-3391d0eb9deb admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001360 Apr 17 10:30:34 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 17 10:30:34 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:30:34 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-4370c137-fb1a-436d-a049-70be2a017f66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "id": "5", "ram": 16384, "disk": 160, "swap": 0, "name": "m1.xlarge"}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:30:34 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-4370c137-fb1a-436d-a049-70be2a017f66 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.062153 Apr 17 10:30:34 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 17 10:30:34 2023] POST /compute/v2.1/flavors => generated 406 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 10:30:34 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-041a4b23-0ec9-456e-9fdb-30f10b45fb2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:30:34 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-041a4b23-0ec9-456e-9fdb-30f10b45fb2b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040334 Apr 17 10:30:34 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Mon Apr 17 10:30:34 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:31:06 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-56b6d115-0720-458e-8f51-3391d0eb9deb admin admin] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:31:06 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-56b6d115-0720-458e-8f51-3391d0eb9deb admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001574 Apr 17 10:31:06 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Mon Apr 17 10:31:06 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:31:06 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:31:06 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-d751280f-98b2-4d8d-8b28-d116f767b5f8 admin admin] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:31:06 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d751280f-98b2-4d8d-8b28-d116f767b5f8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:31:06 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d751280f-98b2-4d8d-8b28-d116f767b5f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:31:06 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d751280f-98b2-4d8d-8b28-d116f767b5f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:31:06 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d751280f-98b2-4d8d-8b28-d116f767b5f8 admin admin] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:31:06 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d751280f-98b2-4d8d-8b28-d116f767b5f8 admin admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:31:06 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d751280f-98b2-4d8d-8b28-d116f767b5f8 admin admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:31:06 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-d751280f-98b2-4d8d-8b28-d116f767b5f8 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.099855 Apr 17 10:31:06 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Mon Apr 17 10:31:06 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 10:31:38 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-041a4b23-0ec9-456e-9fdb-30f10b45fb2b admin admin] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:31:38 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-041a4b23-0ec9-456e-9fdb-30f10b45fb2b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002254 Apr 17 10:31:38 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Mon Apr 17 10:31:38 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:31:38 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:31:38 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-9eb325b8-9512-48bf-9b8f-8dae1d0f2f0f admin admin] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:31:38 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-9eb325b8-9512-48bf-9b8f-8dae1d0f2f0f admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.074041 Apr 17 10:31:38 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Mon Apr 17 10:31:38 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:31:43 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-d751280f-98b2-4d8d-8b28-d116f767b5f8 admin admin] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:31:43 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-d751280f-98b2-4d8d-8b28-d116f767b5f8 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001665 Apr 17 10:31:43 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Mon Apr 17 10:31:43 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:31:43 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:31:43 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-5f6c5567-c696-45c4-91d0-420e2d40147e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "42", "disk": 1, "ram": 128, "name": "m1.nano", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:31:43 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-5f6c5567-c696-45c4-91d0-420e2d40147e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.073868 Apr 17 10:31:43 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Mon Apr 17 10:31:43 2023] POST /compute/v2.1/flavors => generated 403 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 10:31:43 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-1ffcdf69-724b-4df1-8c66-a05b7b2182a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:31:43 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-1ffcdf69-724b-4df1-8c66-a05b7b2182a1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029408 Apr 17 10:31:43 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Mon Apr 17 10:31:43 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:31:47 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-d751280f-98b2-4d8d-8b28-d116f767b5f8 admin admin] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:31:47 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-d751280f-98b2-4d8d-8b28-d116f767b5f8 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001484 Apr 17 10:31:47 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Mon Apr 17 10:31:47 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:31:47 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-24244598-604a-4968-9f59-041d58b5e581 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "84", "name": "m1.micro", "disk": 1, "rxtx_factor": 1.0, "ram": 192, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:31:47 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-24244598-604a-4968-9f59-041d58b5e581 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079030 Apr 17 10:31:47 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Mon Apr 17 10:31:47 2023] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 10:31:47 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-00b37249-f017-48ed-85e1-e51a31858dc1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:31:47 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-00b37249-f017-48ed-85e1-e51a31858dc1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042310 Apr 17 10:31:47 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Mon Apr 17 10:31:47 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:34:09 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:34:09 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:34:09 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=4 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:34:09 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-06277c5f-1506-4971-a15b-8d1d23a26b99 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Action: 'create', calling method: .version_select at 0x7fc55b866d40>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-464739441"}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:34:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-06277c5f-1506-4971-a15b-8d1d23a26b99 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.755744 Apr 17 10:34:11 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1232 bytes} [Mon Apr 17 10:34:09 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 1759 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 17 10:34:11 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:34:11 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-3422158b-02b1-4e39-a92d-f40c4d3e3db7 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55b865b40>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:11 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-3422158b-02b1-4e39-a92d-f40c4d3e3db7 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f" status: 200 len: 344 microversion: 2.1 time: 0.242825 Apr 17 10:34:11 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 17/47] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 10:34:11 2023] GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f => generated 344 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:12 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:34:12 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-57d59e66-ce16-4d20-bfde-d488880f981a tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55b933ac0>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:12 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-1933f2bd-2327-4124-a4fd-8c6c62e6dda5 tempest-VolumesTestJSON-1293387979 tempest-VolumesTestJSON-1293387979-project-member] Calling method '.version_select at 0x7fc55b8ec430>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:12 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-57d59e66-ce16-4d20-bfde-d488880f981a tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f" status: 200 len: 344 microversion: 2.1 time: 0.452581 Apr 17 10:34:12 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 10:34:12 2023] GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f => generated 344 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:13 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-1933f2bd-2327-4124-a4fd-8c6c62e6dda5 tempest-VolumesTestJSON-1293387979 tempest-VolumesTestJSON-1293387979-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/54cf37d2-23d6-4738-9b90-4385e60ff02e" status: 200 len: 351 microversion: 2.1 time: 0.062738 Apr 17 10:34:13 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 10:34:12 2023] GET /compute/v2.1/os-volumes/54cf37d2-23d6-4738-9b90-4385e60ff02e => generated 351 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:14 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-2c49acfd-4628-41b3-bffb-d544c0955a72 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55b8eb760>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:14 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-2c49acfd-4628-41b3-bffb-d544c0955a72 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f" status: 200 len: 345 microversion: 2.1 time: 0.051240 Apr 17 10:34:14 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 10:34:13 2023] GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:14 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-df1eeacc-a159-47d3-80c7-80bd38b9927d tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Action: 'create', calling method: .version_select at 0x7fc55b8d7400>, body: {"snapshot": {"volume_id": "7a5803c1-ab3b-4665-a209-f7e417bc5a0f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-760367482"}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:34:14 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-df1eeacc-a159-47d3-80c7-80bd38b9927d tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.187050 Apr 17 10:34:14 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 17/51] 10.0.0.210 () {64 vars in 1239 bytes} [Mon Apr 17 10:34:14 2023] POST /compute/v2.1/os-snapshots => generated 286 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:14 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-66e6e829-05ad-41b3-8508-166ed99b201a tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55b8ecaf0>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:14 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-66e6e829-05ad-41b3-8508-166ed99b201a tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/03b3c208-97a0-4270-a4a3-dd29462a226b" status: 200 len: 286 microversion: 2.1 time: 0.072506 Apr 17 10:34:14 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1328 bytes} [Mon Apr 17 10:34:14 2023] GET /compute/v2.1/os-snapshots/03b3c208-97a0-4270-a4a3-dd29462a226b => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:14 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-6621b678-3cef-416e-a634-b940096381c4 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55b8ebd90>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:14 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-6621b678-3cef-416e-a634-b940096381c4 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.052342 Apr 17 10:34:14 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1217 bytes} [Mon Apr 17 10:34:14 2023] GET /compute/v2.1/os-snapshots => generated 289 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:14 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-78509c8f-97b1-4b4d-9f75-5869ad3f6350 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55b8ec790>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:14 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-78509c8f-97b1-4b4d-9f75-5869ad3f6350 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/03b3c208-97a0-4270-a4a3-dd29462a226b" status: 200 len: 286 microversion: 2.1 time: 0.056407 Apr 17 10:34:14 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 18/54] 10.0.0.210 () {62 vars in 1328 bytes} [Mon Apr 17 10:34:14 2023] GET /compute/v2.1/os-snapshots/03b3c208-97a0-4270-a4a3-dd29462a226b => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 10:34:15 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-11bb8490-2938-48ac-b85b-cd3abc77f8c8 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55b8ed240>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:15 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-6c40fd00-3fa0-4e56-aa95-62ca73cf142c tempest-VolumesTestJSON-1293387979 tempest-VolumesTestJSON-1293387979-project-member] Calling method '.version_select at 0x7fc55b8ebac0>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:15 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-6c40fd00-3fa0-4e56-aa95-62ca73cf142c tempest-VolumesTestJSON-1293387979 tempest-VolumesTestJSON-1293387979-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/21d99ca8-2efa-4af5-aeab-9875b5f55d33" status: 200 len: 350 microversion: 2.1 time: 0.054158 Apr 17 10:34:15 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 20/55] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 10:34:15 2023] GET /compute/v2.1/os-volumes/21d99ca8-2efa-4af5-aeab-9875b5f55d33 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:15 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-11bb8490-2938-48ac-b85b-cd3abc77f8c8 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/03b3c208-97a0-4270-a4a3-dd29462a226b" status: 200 len: 286 microversion: 2.1 time: 0.245225 Apr 17 10:34:15 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 18/56] 10.0.0.210 () {62 vars in 1328 bytes} [Mon Apr 17 10:34:15 2023] GET /compute/v2.1/os-snapshots/03b3c208-97a0-4270-a4a3-dd29462a226b => generated 286 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:16 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-a8a88d8f-2e90-4ef1-894f-27c0e3623603 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55b8d7be0>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:16 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-a8a88d8f-2e90-4ef1-894f-27c0e3623603 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/03b3c208-97a0-4270-a4a3-dd29462a226b" status: 200 len: 286 microversion: 2.1 time: 0.032489 Apr 17 10:34:16 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 19/57] 10.0.0.210 () {62 vars in 1328 bytes} [Mon Apr 17 10:34:16 2023] GET /compute/v2.1/os-snapshots/03b3c208-97a0-4270-a4a3-dd29462a226b => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:17 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-2c8ffcb4-b8a1-422b-939a-2c650a6bf6c3 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55c29d870>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:17 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-2c8ffcb4-b8a1-422b-939a-2c650a6bf6c3 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/03b3c208-97a0-4270-a4a3-dd29462a226b" status: 200 len: 286 microversion: 2.1 time: 0.034128 Apr 17 10:34:17 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 21/58] 10.0.0.210 () {62 vars in 1328 bytes} [Mon Apr 17 10:34:17 2023] GET /compute/v2.1/os-snapshots/03b3c208-97a0-4270-a4a3-dd29462a226b => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:17 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-e57678b3-fe68-4571-84ed-f660e7da15fa tempest-VolumesTestJSON-1293387979 tempest-VolumesTestJSON-1293387979-project-member] Calling method '.version_select at 0x7fc55b8ed3f0>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:18 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-e57678b3-fe68-4571-84ed-f660e7da15fa tempest-VolumesTestJSON-1293387979 tempest-VolumesTestJSON-1293387979-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/89fe3d4a-87b4-4b6c-a806-9cd58b67a15b" status: 200 len: 351 microversion: 2.1 time: 0.063951 Apr 17 10:34:18 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 19/59] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 10:34:17 2023] GET /compute/v2.1/os-volumes/89fe3d4a-87b4-4b6c-a806-9cd58b67a15b => generated 351 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:18 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-ecfda507-14f2-431f-9fe6-6941d7689483 tempest-VolumesTestJSON-1293387979 tempest-VolumesTestJSON-1293387979-project-member] Calling method '.version_select at 0x7fc55b8d75b0>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:18 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-ecfda507-14f2-431f-9fe6-6941d7689483 tempest-VolumesTestJSON-1293387979 tempest-VolumesTestJSON-1293387979-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.092206 Apr 17 10:34:18 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 20/60] 10.0.0.210 () {62 vars in 1211 bytes} [Mon Apr 17 10:34:18 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:34:18 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-36d1be5e-5bf4-4d87-a507-f4a6797c6e73 tempest-VolumesTestJSON-1293387979 tempest-VolumesTestJSON-1293387979-project-member] Calling method '.version_select at 0x7fc55b7108b0>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:18 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-36d1be5e-5bf4-4d87-a507-f4a6797c6e73 tempest-VolumesTestJSON-1293387979 tempest-VolumesTestJSON-1293387979-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.081684 Apr 17 10:34:18 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 22/61] 10.0.0.210 () {62 vars in 1226 bytes} [Mon Apr 17 10:34:18 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:18 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-932f6460-7c6e-4a24-bce1-f52ff68882aa tempest-VolumesTestJSON-1293387979 tempest-VolumesTestJSON-1293387979-project-member] Calling method '.version_select at 0x7fc55b8ecb80>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:18 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-932f6460-7c6e-4a24-bce1-f52ff68882aa tempest-VolumesTestJSON-1293387979 tempest-VolumesTestJSON-1293387979-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087440 Apr 17 10:34:18 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 20/62] 10.0.0.210 () {62 vars in 1211 bytes} [Mon Apr 17 10:34:18 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:34:18 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-88654bdb-e69a-49e1-a7d8-1ac9a4a755ac tempest-VolumesTestJSON-1293387979 tempest-VolumesTestJSON-1293387979-project-member] Calling method '.version_select at 0x7fc55b8ece50>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:18 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-88654bdb-e69a-49e1-a7d8-1ac9a4a755ac tempest-VolumesTestJSON-1293387979 tempest-VolumesTestJSON-1293387979-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.105415 Apr 17 10:34:18 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 21/63] 10.0.0.210 () {62 vars in 1244 bytes} [Mon Apr 17 10:34:18 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:18 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-2ea00778-ce96-4e18-a75d-7b2427f3e3b5 tempest-VolumesTestJSON-1293387979 tempest-VolumesTestJSON-1293387979-project-member] Calling method '.version_select at 0x7fc55c29dab0>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:18 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-2ea00778-ce96-4e18-a75d-7b2427f3e3b5 tempest-VolumesTestJSON-1293387979 tempest-VolumesTestJSON-1293387979-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.084345 Apr 17 10:34:18 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 23/64] 10.0.0.210 () {62 vars in 1247 bytes} [Mon Apr 17 10:34:18 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:18 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-2633f15e-2650-4581-9cf4-4207042981da tempest-VolumesTestJSON-1293387979 tempest-VolumesTestJSON-1293387979-project-member] Calling method '.version_select at 0x7fc55b8edf30>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:18 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-2633f15e-2650-4581-9cf4-4207042981da tempest-VolumesTestJSON-1293387979 tempest-VolumesTestJSON-1293387979-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086594 Apr 17 10:34:18 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 21/65] 10.0.0.210 () {62 vars in 1232 bytes} [Mon Apr 17 10:34:18 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:34:18 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-40c9131e-877f-4fbb-ae61-9e19238ffa81 tempest-VolumesTestJSON-1293387979 tempest-VolumesTestJSON-1293387979-project-member] Calling method '.version_select at 0x7fc55b8d7e20>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:18 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-40c9131e-877f-4fbb-ae61-9e19238ffa81 tempest-VolumesTestJSON-1293387979 tempest-VolumesTestJSON-1293387979-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.082963 Apr 17 10:34:18 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 22/66] 10.0.0.210 () {62 vars in 1265 bytes} [Mon Apr 17 10:34:18 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:18 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-b2272444-4d40-4005-9020-a30601126277 tempest-VolumesTestJSON-1293387979 tempest-VolumesTestJSON-1293387979-project-member] Calling method '.version_select at 0x7fc55b7101f0>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:18 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-0aa6ee0e-73ef-4160-b6ca-b7cd4e1a1533 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55b8ed750>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:18 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-b2272444-4d40-4005-9020-a30601126277 tempest-VolumesTestJSON-1293387979 tempest-VolumesTestJSON-1293387979-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.090795 Apr 17 10:34:18 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 24/67] 10.0.0.210 () {62 vars in 1232 bytes} [Mon Apr 17 10:34:18 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:34:18 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-0aa6ee0e-73ef-4160-b6ca-b7cd4e1a1533 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/03b3c208-97a0-4270-a4a3-dd29462a226b" status: 200 len: 287 microversion: 2.1 time: 0.040807 Apr 17 10:34:18 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 22/68] 10.0.0.210 () {62 vars in 1328 bytes} [Mon Apr 17 10:34:18 2023] GET /compute/v2.1/os-snapshots/03b3c208-97a0-4270-a4a3-dd29462a226b => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:18 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-f6901afa-2984-4612-a843-1e3d8b390116 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55b8ed7e0>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:18 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-f6901afa-2984-4612-a843-1e3d8b390116 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/03b3c208-97a0-4270-a4a3-dd29462a226b" status: 202 len: 0 microversion: 2.1 time: 0.076540 Apr 17 10:34:18 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 23/69] 10.0.0.210 () {62 vars in 1331 bytes} [Mon Apr 17 10:34:18 2023] DELETE /compute/v2.1/os-snapshots/03b3c208-97a0-4270-a4a3-dd29462a226b => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:34:18 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-00d30fe4-fcf0-4eaa-973e-8b8cd8c9a334 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55b8eba30>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:19 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-00d30fe4-fcf0-4eaa-973e-8b8cd8c9a334 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/03b3c208-97a0-4270-a4a3-dd29462a226b" status: 200 len: 286 microversion: 2.1 time: 0.122889 Apr 17 10:34:19 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 25/70] 10.0.0.210 () {62 vars in 1328 bytes} [Mon Apr 17 10:34:18 2023] GET /compute/v2.1/os-snapshots/03b3c208-97a0-4270-a4a3-dd29462a226b => generated 286 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:20 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-9da53034-b905-4f15-b155-9c277a0737c0 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55b8ec9d0>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:20 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-9da53034-b905-4f15-b155-9c277a0737c0 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/03b3c208-97a0-4270-a4a3-dd29462a226b" status: 200 len: 286 microversion: 2.1 time: 0.033390 Apr 17 10:34:20 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 23/71] 10.0.0.210 () {62 vars in 1328 bytes} [Mon Apr 17 10:34:20 2023] GET /compute/v2.1/os-snapshots/03b3c208-97a0-4270-a4a3-dd29462a226b => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 10:34:21 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-233d0217-765f-4c1a-aa3f-904e6a60ea87 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55b8edf30>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:21 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-233d0217-765f-4c1a-aa3f-904e6a60ea87 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/03b3c208-97a0-4270-a4a3-dd29462a226b" status: 200 len: 286 microversion: 2.1 time: 0.042492 Apr 17 10:34:21 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 24/72] 10.0.0.210 () {62 vars in 1328 bytes} [Mon Apr 17 10:34:21 2023] GET /compute/v2.1/os-snapshots/03b3c208-97a0-4270-a4a3-dd29462a226b => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:22 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-6998b142-07e1-408c-9b26-a607cd853364 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55c29d870>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:22 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-6998b142-07e1-408c-9b26-a607cd853364 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] HTTP exception thrown: Snapshot 03b3c208-97a0-4270-a4a3-dd29462a226b could not be found. Apr 17 10:34:22 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-6998b142-07e1-408c-9b26-a607cd853364 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Request method failure captured: Apr 17 10:34:22 user devstack@n-api.service[72745]: request: GET /compute/v2.1/os-snapshots/03b3c208-97a0-4270-a4a3-dd29462a226b HTTP/1.1 Apr 17 10:34:22 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:34:22 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:34:22 user devstack@n-api.service[72745]: Connection: close Apr 17 10:34:22 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 10:34:22 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:34:22 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:34:22 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:34:22 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:34:22 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSChDVQ7xPgV1o64zyF1msrj1ZEebSAyaRjd1UdgS0Yz0oKUNjSmzm8FQfpXWJ1LmFsXJ8FCyzbNHq75-xDpo_VEv_e8-JELc5gNl13Pm_2mzgA5GLRdOL-oFU4-qmrzjVPdCEpkN2yeNVuDWBh9LyaDPf_xMNuNTI-dVJWDURYiMaM Apr 17 10:34:22 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:34:22 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:34:22 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:34:22 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:34:22 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:34:22 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:34:22 user devstack@n-api.service[72745]: X-Project-Id: 41cc228e70e847d38218c394d2a30c31 Apr 17 10:34:22 user devstack@n-api.service[72745]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-656588608 Apr 17 10:34:22 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:34:22 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:34:22 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/41cc228e70e847d38218c394d2a30c31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/41cc228e70e847d38218c394d2a30c31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/41cc228e70e847d38218c394d2a30c31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:34:22 user devstack@n-api.service[72745]: X-Tenant: tempest-VolumesSnapshotsTestJSON-656588608 Apr 17 10:34:22 user devstack@n-api.service[72745]: X-Tenant-Id: 41cc228e70e847d38218c394d2a30c31 Apr 17 10:34:22 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-656588608 Apr 17 10:34:22 user devstack@n-api.service[72745]: X-User: tempest-VolumesSnapshotsTestJSON-656588608-project-member Apr 17 10:34:22 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:34:22 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:34:22 user devstack@n-api.service[72745]: X-User-Id: 95d7a3a8019f4c0c86c8cb70df0025be Apr 17 10:34:22 user devstack@n-api.service[72745]: X-User-Name: tempest-VolumesSnapshotsTestJSON-656588608-project-member Apr 17 10:34:22 user devstack@n-api.service[72745]: method: Apr 17 10:34:22 user devstack@n-api.service[72745]: exception: Snapshot 03b3c208-97a0-4270-a4a3-dd29462a226b could not be found. Apr 17 10:34:22 user devstack@n-api.service[72745]: action_args: {'id': '03b3c208-97a0-4270-a4a3-dd29462a226b'} Apr 17 10:34:22 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 03b3c208-97a0-4270-a4a3-dd29462a226b could not be found. (HTTP 404) (Request-ID: req-1d537cdb-4b86-4cb8-8073-5c5d7ea9da80) Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 03b3c208-97a0-4270-a4a3-dd29462a226b could not be found. Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 03b3c208-97a0-4270-a4a3-dd29462a226b could not be found. Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 03b3c208-97a0-4270-a4a3-dd29462a226b could not be found. Apr 17 10:34:22 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:34:22 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-6998b142-07e1-408c-9b26-a607cd853364 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Returning 404 to user: Snapshot 03b3c208-97a0-4270-a4a3-dd29462a226b could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:34:22 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-6998b142-07e1-408c-9b26-a607cd853364 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/03b3c208-97a0-4270-a4a3-dd29462a226b" status: 404 len: 111 microversion: 2.1 time: 0.040612 Apr 17 10:34:22 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 26/73] 10.0.0.210 () {62 vars in 1328 bytes} [Mon Apr 17 10:34:22 2023] GET /compute/v2.1/os-snapshots/03b3c208-97a0-4270-a4a3-dd29462a226b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:34:22 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-dfdacf6d-f116-4ddb-a4cc-452cc5e763f8 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55b8ecf70>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:22 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-dfdacf6d-f116-4ddb-a4cc-452cc5e763f8 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f" status: 202 len: 0 microversion: 2.1 time: 0.093219 Apr 17 10:34:22 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 24/74] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 17 10:34:22 2023] DELETE /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:34:22 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-a694943e-9126-46e6-b700-9d6765d49453 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55b8d79a0>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:22 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-a694943e-9126-46e6-b700-9d6765d49453 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f" status: 200 len: 344 microversion: 2.1 time: 0.058225 Apr 17 10:34:22 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 25/75] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 10:34:22 2023] GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:23 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-08adaeb2-a57b-4e11-b4fb-df9f648a47c8 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55b710040>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:23 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-08adaeb2-a57b-4e11-b4fb-df9f648a47c8 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f" status: 200 len: 344 microversion: 2.1 time: 0.055582 Apr 17 10:34:23 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 27/76] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 10:34:23 2023] GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:24 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-60924cc4-9f47-4cf8-95c7-638fe0e71cd5 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55b8ed1b0>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:24 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-60924cc4-9f47-4cf8-95c7-638fe0e71cd5 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f" status: 200 len: 344 microversion: 2.1 time: 0.063267 Apr 17 10:34:24 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 25/77] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 10:34:24 2023] GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:25 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-86505d54-60db-4b0a-9884-12ffef0f04c9 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55b711480>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:25 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-dfe4de49-3ff0-435f-80b0-9514e7f7c72a tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Action: 'create', calling method: .version_select at 0x7fc55b8ee290>, body: {"keypair": {"name": "tempest-keypair-1429660859", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4Kj9hvbP1aVQII/7QiaHRWXofwSnpWqLBclyr4p/sJ9vVwkcLRcx3jF4aBPRNO8VNcKrUVg/RMpYsEZOv9NdGHwG82Y0eMLyIYtz8JbbzLgm6YOfqq+L3EFxeQcH24mw=="}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:34:25 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-86505d54-60db-4b0a-9884-12ffef0f04c9 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f" status: 200 len: 344 microversion: 2.1 time: 0.112443 Apr 17 10:34:25 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 28/78] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 10:34:25 2023] GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f => generated 344 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:25 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-611330270", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "networks": [{"uuid": "5678ceef-3151-4d42-9106-9996eafd66f1"}]}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:34:25 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-dfe4de49-3ff0-435f-80b0-9514e7f7c72a tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Getting quotas for project 6a17ec3e1b314acbb701f2d2d27d0560. Resources: {'key_pairs'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:34:25 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-dfe4de49-3ff0-435f-80b0-9514e7f7c72a tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Getting quotas for user a9862432f87f4500a46f32a0b27d54d4 and project 6a17ec3e1b314acbb701f2d2d27d0560. Resources: {'key_pairs'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:34:25 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-dfe4de49-3ff0-435f-80b0-9514e7f7c72a tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.306584 Apr 17 10:34:25 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 26/79] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 10:34:25 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:25 user devstack@n-api.service[72744]: DEBUG nova.network.neutron [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] validate_networks() for [('5678ceef-3151-4d42-9106-9996eafd66f1', None, None, None, None, None)] {{(pid=72744) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:34:26 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-e87bfeae-5377-4e66-a046-2daab7db8e10 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55b711bd0>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:26 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-e87bfeae-5377-4e66-a046-2daab7db8e10 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f" status: 200 len: 344 microversion: 2.1 time: 0.052586 Apr 17 10:34:26 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 29/80] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 10:34:26 2023] GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:27 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-04cd492c-ada0-48e1-be93-59e4424eccb2 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55b7523b0>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:27 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-04cd492c-ada0-48e1-be93-59e4424eccb2 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f" status: 200 len: 344 microversion: 2.1 time: 0.081970 Apr 17 10:34:27 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 27/81] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 10:34:27 2023] GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f => generated 344 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:28 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Flavor limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:34:28 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Image limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:34:28 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Flavor pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:34:28 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Image pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:34:28 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:34:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:28 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Getting quotas for project faab4afa0ddf45578232627c2fac2ff8. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:34:28 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Getting quotas for user d8cb73d24d324903a625e4782270120e and project faab4afa0ddf45578232627c2fac2ff8. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:34:28 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Going to run 1 instances... {{(pid=72744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:34:28 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:34:28 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-6b4d36e8-ba8e-4f34-b470-8711de4d2eec tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55b7100d0>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:28 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-3268188e-024b-42b0-91d0-c3ccad4c81d4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 3.203230 Apr 17 10:34:28 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 26/82] 10.0.0.210 () {66 vars in 1265 bytes} [Mon Apr 17 10:34:25 2023] POST /compute/v2.1/servers => generated 378 bytes in 3206 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Apr 17 10:34:28 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-114b046f-0ccb-4719-aa79-e8c913bd65f7 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:28 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-114b046f-0ccb-4719-aa79-e8c913bd65f7 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:34:28 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-6b4d36e8-ba8e-4f34-b470-8711de4d2eec tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f" status: 200 len: 344 microversion: 2.1 time: 0.058744 Apr 17 10:34:28 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 30/83] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 10:34:28 2023] GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:29 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-114b046f-0ccb-4719-aa79-e8c913bd65f7 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:34:29 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-114b046f-0ccb-4719-aa79-e8c913bd65f7 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:34:29 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-114b046f-0ccb-4719-aa79-e8c913bd65f7 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:34:29 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-114b046f-0ccb-4719-aa79-e8c913bd65f7 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/60008675-7786-4a26-9640-49da6efd0adb" status: 200 len: 1394 microversion: 2.87 time: 0.289914 Apr 17 10:34:29 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 28/84] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:34:28 2023] GET /compute/v2.1/servers/60008675-7786-4a26-9640-49da6efd0adb => generated 1394 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:34:29 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2104151254", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "networks": [{"uuid": "7923a088-f9c0-4c11-9907-e94389c269f0"}]}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:34:29 user devstack@n-api.service[72744]: DEBUG nova.network.neutron [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] validate_networks() for [('7923a088-f9c0-4c11-9907-e94389c269f0', None, None, None, None, None)] {{(pid=72744) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:34:29 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-7a53f4d9-986b-45a4-8b8e-c10dd6ef9a0e tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55b7120e0>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:29 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-7a53f4d9-986b-45a4-8b8e-c10dd6ef9a0e tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f" status: 200 len: 344 microversion: 2.1 time: 0.091441 Apr 17 10:34:29 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 31/85] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 10:34:29 2023] GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f => generated 344 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:30 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-407b71f0-4fa2-4b9b-8747-17c12dfa60c9 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Action: 'create', calling method: .version_select at 0x7fc55b8ed1b0>, body: {"keypair": {"name": "tempest-keypair-850060525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnvtiDTDPjiz0hQ6df6omtPSqLx8cphP5uhCzg3kQ4E0fo/fGmWEtXCk0ZdSSLB3uDiMb6lTel263kG9OXq4VKHzNS8Ca9hU4viwWvpL2VficVcm9xF14aNByKdknbl9g=="}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:34:30 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-407b71f0-4fa2-4b9b-8747-17c12dfa60c9 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Getting quotas for project e6dac880f4294283ae7838bfa0edf5c1. Resources: {'key_pairs'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:34:30 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-407b71f0-4fa2-4b9b-8747-17c12dfa60c9 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Getting quotas for user aea97828312f45ffa1b7148c375a7f9a and project e6dac880f4294283ae7838bfa0edf5c1. Resources: {'key_pairs'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:34:30 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-407b71f0-4fa2-4b9b-8747-17c12dfa60c9 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.155156 Apr 17 10:34:30 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 29/86] 10.0.0.210 () {66 vars in 1277 bytes} [Mon Apr 17 10:34:30 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 160 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 17 10:34:30 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-d1eafd00-f819-41da-a5c4-6f1995924acb tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55b712170>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:31 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-d1eafd00-f819-41da-a5c4-6f1995924acb tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f" status: 200 len: 344 microversion: 2.1 time: 0.098292 Apr 17 10:34:31 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 32/87] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 10:34:30 2023] GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f => generated 344 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:31 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Flavor limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:34:31 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Image limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:34:31 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Flavor pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:34:31 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Image pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:34:31 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:34:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:31 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Getting quotas for project 02daa1fd267646fbb4f726b247ba4a6b. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:34:31 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Getting quotas for user 7f4863ef9d61412a997abf4f27cce1b7 and project 02daa1fd267646fbb4f726b247ba4a6b. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:34:31 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Going to run 1 instances... {{(pid=72744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:34:31 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:34:31 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-1a8b2853-ca31-46ca-b90c-15f16c534b57 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.614185 Apr 17 10:34:31 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 27/88] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:34:29 2023] POST /compute/v2.1/servers => generated 378 bytes in 2617 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 10:34:32 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-47195679-37a6-4265-9298-46dab1f14883 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:32 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-47195679-37a6-4265-9298-46dab1f14883 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:34:32 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-4862cfd7-3bc0-4dd3-8b77-c8579d4f3b3f tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55b7100d0>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:32 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-4862cfd7-3bc0-4dd3-8b77-c8579d4f3b3f tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] HTTP exception thrown: Volume 7a5803c1-ab3b-4665-a209-f7e417bc5a0f could not be found. Apr 17 10:34:32 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-4862cfd7-3bc0-4dd3-8b77-c8579d4f3b3f tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Request method failure captured: Apr 17 10:34:32 user devstack@n-api.service[72745]: request: GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f HTTP/1.1 Apr 17 10:34:32 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:34:32 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:34:32 user devstack@n-api.service[72745]: Connection: close Apr 17 10:34:32 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 10:34:32 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:34:32 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:34:32 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:34:32 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSChDVQ7xPgV1o64zyF1msrj1ZEebSAyaRjd1UdgS0Yz0oKUNjSmzm8FQfpXWJ1LmFsXJ8FCyzbNHq75-xDpo_VEv_e8-JELc5gNl13Pm_2mzgA5GLRdOL-oFU4-qmrzjVPdCEpkN2yeNVuDWBh9LyaDPf_xMNuNTI-dVJWDURYiMaM Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Project-Id: 41cc228e70e847d38218c394d2a30c31 Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-656588608 Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/41cc228e70e847d38218c394d2a30c31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/41cc228e70e847d38218c394d2a30c31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/41cc228e70e847d38218c394d2a30c31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Tenant: tempest-VolumesSnapshotsTestJSON-656588608 Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Tenant-Id: 41cc228e70e847d38218c394d2a30c31 Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-656588608 Apr 17 10:34:32 user devstack@n-api.service[72745]: X-User: tempest-VolumesSnapshotsTestJSON-656588608-project-member Apr 17 10:34:32 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:34:32 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:34:32 user devstack@n-api.service[72745]: X-User-Id: 95d7a3a8019f4c0c86c8cb70df0025be Apr 17 10:34:32 user devstack@n-api.service[72745]: X-User-Name: tempest-VolumesSnapshotsTestJSON-656588608-project-member Apr 17 10:34:32 user devstack@n-api.service[72745]: method: Apr 17 10:34:32 user devstack@n-api.service[72745]: exception: Volume 7a5803c1-ab3b-4665-a209-f7e417bc5a0f could not be found. Apr 17 10:34:32 user devstack@n-api.service[72745]: action_args: {'id': '7a5803c1-ab3b-4665-a209-f7e417bc5a0f'} Apr 17 10:34:32 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7a5803c1-ab3b-4665-a209-f7e417bc5a0f could not be found. (HTTP 404) (Request-ID: req-7f06e3c0-7231-461d-af5e-f13bda5ecc0d) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7a5803c1-ab3b-4665-a209-f7e417bc5a0f could not be found. Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7a5803c1-ab3b-4665-a209-f7e417bc5a0f could not be found. Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7a5803c1-ab3b-4665-a209-f7e417bc5a0f could not be found. Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:34:32 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-4862cfd7-3bc0-4dd3-8b77-c8579d4f3b3f tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Returning 404 to user: Volume 7a5803c1-ab3b-4665-a209-f7e417bc5a0f could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:34:32 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-4862cfd7-3bc0-4dd3-8b77-c8579d4f3b3f tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f" status: 404 len: 109 microversion: 2.1 time: 0.047441 Apr 17 10:34:32 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 33/89] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 10:34:32 2023] GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:34:32 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-12773a1e-551e-444e-965b-894dbb7d1cd4 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55b7d5480>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:32 user devstack@n-api.service[72744]: INFO nova.api.openstack.wsgi [None req-12773a1e-551e-444e-965b-894dbb7d1cd4 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] HTTP exception thrown: Volume 7a5803c1-ab3b-4665-a209-f7e417bc5a0f could not be found. Apr 17 10:34:32 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-12773a1e-551e-444e-965b-894dbb7d1cd4 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Request method failure captured: Apr 17 10:34:32 user devstack@n-api.service[72744]: request: DELETE /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f HTTP/1.1 Apr 17 10:34:32 user devstack@n-api.service[72744]: Accept: application/json Apr 17 10:34:32 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 10:34:32 user devstack@n-api.service[72744]: Connection: close Apr 17 10:34:32 user devstack@n-api.service[72744]: Content-Length: 0 Apr 17 10:34:32 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 10:34:32 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 10:34:32 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 10:34:32 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 10:34:32 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSChDVQ7xPgV1o64zyF1msrj1ZEebSAyaRjd1UdgS0Yz0oKUNjSmzm8FQfpXWJ1LmFsXJ8FCyzbNHq75-xDpo_VEv_e8-JELc5gNl13Pm_2mzgA5GLRdOL-oFU4-qmrzjVPdCEpkN2yeNVuDWBh9LyaDPf_xMNuNTI-dVJWDURYiMaM Apr 17 10:34:32 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 10:34:32 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 10:34:32 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 10:34:32 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 10:34:32 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 10:34:32 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 10:34:32 user devstack@n-api.service[72744]: X-Project-Id: 41cc228e70e847d38218c394d2a30c31 Apr 17 10:34:32 user devstack@n-api.service[72744]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-656588608 Apr 17 10:34:32 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 10:34:32 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 10:34:32 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/41cc228e70e847d38218c394d2a30c31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/41cc228e70e847d38218c394d2a30c31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/41cc228e70e847d38218c394d2a30c31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:34:32 user devstack@n-api.service[72744]: X-Tenant: tempest-VolumesSnapshotsTestJSON-656588608 Apr 17 10:34:32 user devstack@n-api.service[72744]: X-Tenant-Id: 41cc228e70e847d38218c394d2a30c31 Apr 17 10:34:32 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-656588608 Apr 17 10:34:32 user devstack@n-api.service[72744]: X-User: tempest-VolumesSnapshotsTestJSON-656588608-project-member Apr 17 10:34:32 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 10:34:32 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 10:34:32 user devstack@n-api.service[72744]: X-User-Id: 95d7a3a8019f4c0c86c8cb70df0025be Apr 17 10:34:32 user devstack@n-api.service[72744]: X-User-Name: tempest-VolumesSnapshotsTestJSON-656588608-project-member Apr 17 10:34:32 user devstack@n-api.service[72744]: method: Apr 17 10:34:32 user devstack@n-api.service[72744]: exception: Volume 7a5803c1-ab3b-4665-a209-f7e417bc5a0f could not be found. Apr 17 10:34:32 user devstack@n-api.service[72744]: action_args: {'id': '7a5803c1-ab3b-4665-a209-f7e417bc5a0f'} Apr 17 10:34:32 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7a5803c1-ab3b-4665-a209-f7e417bc5a0f could not be found. (HTTP 404) (Request-ID: req-a9027c47-a200-49b1-a6cc-3f1061b0fda6) Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7a5803c1-ab3b-4665-a209-f7e417bc5a0f could not be found. Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7a5803c1-ab3b-4665-a209-f7e417bc5a0f could not be found. Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7a5803c1-ab3b-4665-a209-f7e417bc5a0f could not be found. Apr 17 10:34:32 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:34:32 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-12773a1e-551e-444e-965b-894dbb7d1cd4 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Returning 404 to user: Volume 7a5803c1-ab3b-4665-a209-f7e417bc5a0f could not be found. {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:34:32 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-12773a1e-551e-444e-965b-894dbb7d1cd4 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f" status: 404 len: 109 microversion: 2.1 time: 0.070827 Apr 17 10:34:32 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 28/90] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 17 10:34:32 2023] DELETE /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:34:32 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-00ebb698-61a7-4082-90c8-903f2affafe2 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Calling method '.version_select at 0x7fc55b710820>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:32 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-00ebb698-61a7-4082-90c8-903f2affafe2 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] HTTP exception thrown: Volume 7a5803c1-ab3b-4665-a209-f7e417bc5a0f could not be found. Apr 17 10:34:32 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-00ebb698-61a7-4082-90c8-903f2affafe2 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Request method failure captured: Apr 17 10:34:32 user devstack@n-api.service[72745]: request: GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f HTTP/1.1 Apr 17 10:34:32 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:34:32 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:34:32 user devstack@n-api.service[72745]: Connection: close Apr 17 10:34:32 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 10:34:32 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:34:32 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:34:32 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:34:32 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSChDVQ7xPgV1o64zyF1msrj1ZEebSAyaRjd1UdgS0Yz0oKUNjSmzm8FQfpXWJ1LmFsXJ8FCyzbNHq75-xDpo_VEv_e8-JELc5gNl13Pm_2mzgA5GLRdOL-oFU4-qmrzjVPdCEpkN2yeNVuDWBh9LyaDPf_xMNuNTI-dVJWDURYiMaM Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Project-Id: 41cc228e70e847d38218c394d2a30c31 Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-656588608 Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/41cc228e70e847d38218c394d2a30c31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/41cc228e70e847d38218c394d2a30c31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/41cc228e70e847d38218c394d2a30c31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Tenant: tempest-VolumesSnapshotsTestJSON-656588608 Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Tenant-Id: 41cc228e70e847d38218c394d2a30c31 Apr 17 10:34:32 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-656588608 Apr 17 10:34:32 user devstack@n-api.service[72745]: X-User: tempest-VolumesSnapshotsTestJSON-656588608-project-member Apr 17 10:34:32 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:34:32 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:34:32 user devstack@n-api.service[72745]: X-User-Id: 95d7a3a8019f4c0c86c8cb70df0025be Apr 17 10:34:32 user devstack@n-api.service[72745]: X-User-Name: tempest-VolumesSnapshotsTestJSON-656588608-project-member Apr 17 10:34:32 user devstack@n-api.service[72745]: method: Apr 17 10:34:32 user devstack@n-api.service[72745]: exception: Volume 7a5803c1-ab3b-4665-a209-f7e417bc5a0f could not be found. Apr 17 10:34:32 user devstack@n-api.service[72745]: action_args: {'id': '7a5803c1-ab3b-4665-a209-f7e417bc5a0f'} Apr 17 10:34:32 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7a5803c1-ab3b-4665-a209-f7e417bc5a0f could not be found. (HTTP 404) (Request-ID: req-8b53311b-2f97-4b19-97fe-ab4dcc8d8785) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7a5803c1-ab3b-4665-a209-f7e417bc5a0f could not be found. Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7a5803c1-ab3b-4665-a209-f7e417bc5a0f could not be found. Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7a5803c1-ab3b-4665-a209-f7e417bc5a0f could not be found. Apr 17 10:34:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:34:32 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-00ebb698-61a7-4082-90c8-903f2affafe2 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] Returning 404 to user: Volume 7a5803c1-ab3b-4665-a209-f7e417bc5a0f could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:34:32 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-00ebb698-61a7-4082-90c8-903f2affafe2 tempest-VolumesSnapshotsTestJSON-656588608 tempest-VolumesSnapshotsTestJSON-656588608-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f" status: 404 len: 109 microversion: 2.1 time: 0.052587 Apr 17 10:34:32 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 34/91] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 10:34:32 2023] GET /compute/v2.1/os-volumes/7a5803c1-ab3b-4665-a209-f7e417bc5a0f => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:34:32 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-47195679-37a6-4265-9298-46dab1f14883 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4863ef9d61412a997abf4f27cce1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02daa1fd267646fbb4f726b247ba4a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:34:32 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-47195679-37a6-4265-9298-46dab1f14883 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cc638ee-d494-4523-8d12-9ede0853ecd6" status: 200 len: 1209 microversion: 2.1 time: 0.424903 Apr 17 10:34:32 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 30/92] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:34:32 2023] GET /compute/v2.1/servers/6cc638ee-d494-4523-8d12-9ede0853ecd6 => generated 1209 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:34:35 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-1f2cf8f0-a790-4d0f-8a06-471898f2da99 req-9486d471-4be3-4b3f-b53a-f52bc4d2054e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60008675-7786-4a26-9640-49da6efd0adb", "tag": "d6e0e749-1043-40c1-8401-8aae219f3924"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:34:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-1f2cf8f0-a790-4d0f-8a06-471898f2da99 req-9486d471-4be3-4b3f-b53a-f52bc4d2054e service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-1f2cf8f0-a790-4d0f-8a06-471898f2da99 req-9486d471-4be3-4b3f-b53a-f52bc4d2054e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-1f2cf8f0-a790-4d0f-8a06-471898f2da99 req-9486d471-4be3-4b3f-b53a-f52bc4d2054e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:35 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-92438997", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61"}], "security_groups": [{"name": "tempest-securitygroup--356517992"}], "key_name": "tempest-keypair-1429660859", "user_data": "}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:34:35 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-1f2cf8f0-a790-4d0f-8a06-471898f2da99 req-9486d471-4be3-4b3f-b53a-f52bc4d2054e service nova] Creating event network-changed:d6e0e749-1043-40c1-8401-8aae219f3924 for instance 60008675-7786-4a26-9640-49da6efd0adb on user Apr 17 10:34:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-1f2cf8f0-a790-4d0f-8a06-471898f2da99 req-9486d471-4be3-4b3f-b53a-f52bc4d2054e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=72744) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 17 10:34:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-1f2cf8f0-a790-4d0f-8a06-471898f2da99 req-9486d471-4be3-4b3f-b53a-f52bc4d2054e service nova] Acquired lock "compute-rpcapi-router" {{(pid=72744) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 17 10:34:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f1eb8d81-6953-4fab-bcf5-a8469c636446 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f1eb8d81-6953-4fab-bcf5-a8469c636446 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f1eb8d81-6953-4fab-bcf5-a8469c636446 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f1eb8d81-6953-4fab-bcf5-a8469c636446 None None] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f1eb8d81-6953-4fab-bcf5-a8469c636446 None None] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f1eb8d81-6953-4fab-bcf5-a8469c636446 None None] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:35 user devstack@n-api.service[72744]: INFO nova.compute.rpcapi [None req-f1eb8d81-6953-4fab-bcf5-a8469c636446 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 17 10:34:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f1eb8d81-6953-4fab-bcf5-a8469c636446 None None] Releasing lock "compute-rpcapi-router" {{(pid=72744) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 17 10:34:35 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-f1eb8d81-6953-4fab-bcf5-a8469c636446 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.295564 Apr 17 10:34:35 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 29/93] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:34:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:35 user devstack@n-api.service[72745]: DEBUG nova.network.neutron [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] validate_networks() for [('9950f007-dbcc-4b9f-911a-7bd6a67f2c61', None, None, None, None, None)] {{(pid=72745) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:34:36 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-0c28420b-6962-4780-8598-08abba94267d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Action: 'create', calling method: .version_select at 0x7fc55b753370>, body: {"keypair": {"name": "tempest-keypair-690522544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMwn+C+1/WvqV85P8Z+0YbdwvuPA1JRVCsTkMku5wTk3lWyccqRP3BA+GEJxUJW41c3kbKZgFZYKS36Yqqk/bayBcZoFHQqGTKsw0QCKdBNYqIi+SXQR7Q9/idwCJCSQQ=="}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:34:36 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-0c28420b-6962-4780-8598-08abba94267d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Getting quotas for project 850462faec874544bdc01dd14746d558. Resources: {'key_pairs'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:34:36 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-0c28420b-6962-4780-8598-08abba94267d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Getting quotas for user 282298df65264595b5d7351066128b1a and project 850462faec874544bdc01dd14746d558. Resources: {'key_pairs'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:34:36 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-0c28420b-6962-4780-8598-08abba94267d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.249177 Apr 17 10:34:36 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 31/94] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 10:34:36 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:37 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Flavor limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:34:37 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Image limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:34:37 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Flavor pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:34:37 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Image pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:34:37 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:34:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:37 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Getting quotas for project 6a17ec3e1b314acbb701f2d2d27d0560. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:34:37 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Getting quotas for user a9862432f87f4500a46f32a0b27d54d4 and project 6a17ec3e1b314acbb701f2d2d27d0560. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:34:37 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Going to run 1 instances... {{(pid=72745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:34:37 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:34:37 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-800944ce-3760-4952-a064-cd5c930c771f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 2.293516 Apr 17 10:34:37 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 35/95] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:34:35 2023] POST /compute/v2.1/servers => generated 399 bytes in 2295 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 10:34:37 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-77d50a46-45ce-4f32-ae2f-b38f596ad11a tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:37 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-77d50a46-45ce-4f32-ae2f-b38f596ad11a tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:34:37 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-146173286", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "7f2d57e1-037c-452b-ad18-1257d186c845"}], "security_groups": [{"name": "tempest-securitygroup--95334738"}], "key_name": "tempest-keypair-850060525", "user_data": "}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:34:37 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-77d50a46-45ce-4f32-ae2f-b38f596ad11a tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9862432f87f4500a46f32a0b27d54d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a17ec3e1b314acbb701f2d2d27d0560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:34:37 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-77d50a46-45ce-4f32-ae2f-b38f596ad11a tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99" status: 200 len: 1230 microversion: 2.1 time: 0.140971 Apr 17 10:34:37 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 30/96] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:34:37 2023] GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99 => generated 1230 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 17 10:34:37 user devstack@n-api.service[72743]: DEBUG nova.network.neutron [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] validate_networks() for [('7f2d57e1-037c-452b-ad18-1257d186c845', None, None, None, None, None)] {{(pid=72743) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:34:39 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-298d2052-9be6-4510-885f-9cfc42595949 req-d2038eaa-48ad-4694-b9f0-a837893a31c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cc638ee-d494-4523-8d12-9ede0853ecd6", "tag": "d6ac6671-38e6-49a1-ba35-e903ffc15afa"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:34:39 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-298d2052-9be6-4510-885f-9cfc42595949 req-d2038eaa-48ad-4694-b9f0-a837893a31c8 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:39 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-298d2052-9be6-4510-885f-9cfc42595949 req-d2038eaa-48ad-4694-b9f0-a837893a31c8 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:39 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-298d2052-9be6-4510-885f-9cfc42595949 req-d2038eaa-48ad-4694-b9f0-a837893a31c8 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:39 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-298d2052-9be6-4510-885f-9cfc42595949 req-d2038eaa-48ad-4694-b9f0-a837893a31c8 service nova] Creating event network-changed:d6ac6671-38e6-49a1-ba35-e903ffc15afa for instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 on user Apr 17 10:34:39 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-298d2052-9be6-4510-885f-9cfc42595949 req-d2038eaa-48ad-4694-b9f0-a837893a31c8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=72745) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 17 10:34:39 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-298d2052-9be6-4510-885f-9cfc42595949 req-d2038eaa-48ad-4694-b9f0-a837893a31c8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=72745) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 17 10:34:39 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-750b88eb-3355-4146-be9a-567041fe9d8f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:39 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-750b88eb-3355-4146-be9a-567041fe9d8f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:39 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-750b88eb-3355-4146-be9a-567041fe9d8f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:39 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-750b88eb-3355-4146-be9a-567041fe9d8f None None] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:39 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-750b88eb-3355-4146-be9a-567041fe9d8f None None] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:39 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-750b88eb-3355-4146-be9a-567041fe9d8f None None] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:39 user devstack@n-api.service[72745]: INFO nova.compute.rpcapi [None req-750b88eb-3355-4146-be9a-567041fe9d8f None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 17 10:34:39 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-750b88eb-3355-4146-be9a-567041fe9d8f None None] Releasing lock "compute-rpcapi-router" {{(pid=72745) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 17 10:34:39 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-750b88eb-3355-4146-be9a-567041fe9d8f None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191682 Apr 17 10:34:39 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 36/97] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:34:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:40 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Flavor limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:34:40 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Image limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:34:40 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Flavor pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:34:40 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Image pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:34:40 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:34:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:40 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Getting quotas for project e6dac880f4294283ae7838bfa0edf5c1. Resources: {'cores', 'instances', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:34:40 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Getting quotas for user aea97828312f45ffa1b7148c375a7f9a and project e6dac880f4294283ae7838bfa0edf5c1. Resources: {'cores', 'instances', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:34:40 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Going to run 1 instances... {{(pid=72743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:34:40 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:34:40 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-2e0ffb8b-f65a-4aed-a110-75755022c560 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 398 microversion: 2.20 time: 2.624052 Apr 17 10:34:40 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 32/98] 10.0.0.210 () {66 vars in 1265 bytes} [Mon Apr 17 10:34:37 2023] POST /compute/v2.1/servers => generated 398 bytes in 2626 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 17 10:34:40 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-73bb779a-58aa-4c5a-bf0a-3c867f1f9473 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:40 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-73bb779a-58aa-4c5a-bf0a-3c867f1f9473 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:34:40 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-73bb779a-58aa-4c5a-bf0a-3c867f1f9473 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:34:40 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-73bb779a-58aa-4c5a-bf0a-3c867f1f9473 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:34:40 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-73bb779a-58aa-4c5a-bf0a-3c867f1f9473 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:34:40 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-73bb779a-58aa-4c5a-bf0a-3c867f1f9473 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d" status: 200 len: 1274 microversion: 2.20 time: 0.185031 Apr 17 10:34:40 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 31/99] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:34:40 2023] GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d => generated 1274 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:34:41 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-5010d6fc-4518-490e-8cb7-92eef2b8fa57 req-b5a5f47a-56cc-4b91-960c-b21d63f147ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60008675-7786-4a26-9640-49da6efd0adb", "name": "network-vif-plugged", "status": "completed", "tag": "d6e0e749-1043-40c1-8401-8aae219f3924"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:34:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-5010d6fc-4518-490e-8cb7-92eef2b8fa57 req-b5a5f47a-56cc-4b91-960c-b21d63f147ec service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-5010d6fc-4518-490e-8cb7-92eef2b8fa57 req-b5a5f47a-56cc-4b91-960c-b21d63f147ec service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-5010d6fc-4518-490e-8cb7-92eef2b8fa57 req-b5a5f47a-56cc-4b91-960c-b21d63f147ec service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:41 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-5010d6fc-4518-490e-8cb7-92eef2b8fa57 req-b5a5f47a-56cc-4b91-960c-b21d63f147ec service nova] Creating event network-vif-plugged:d6e0e749-1043-40c1-8401-8aae219f3924 for instance 60008675-7786-4a26-9640-49da6efd0adb on user Apr 17 10:34:41 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-5010d6fc-4518-490e-8cb7-92eef2b8fa57 req-b5a5f47a-56cc-4b91-960c-b21d63f147ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041136 Apr 17 10:34:41 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 37/100] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:34:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:42 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-523c0f54-34e0-4252-b60e-0629ab5418fa req-3c3f8ef8-e62d-4fb8-8297-b1059dcca33f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59fd26de-d46e-4f41-91f6-090005a07d99", "tag": "7124043d-665c-4a42-a041-b91ccc237b63"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:34:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-523c0f54-34e0-4252-b60e-0629ab5418fa req-3c3f8ef8-e62d-4fb8-8297-b1059dcca33f service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-523c0f54-34e0-4252-b60e-0629ab5418fa req-3c3f8ef8-e62d-4fb8-8297-b1059dcca33f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-523c0f54-34e0-4252-b60e-0629ab5418fa req-3c3f8ef8-e62d-4fb8-8297-b1059dcca33f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:42 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-523c0f54-34e0-4252-b60e-0629ab5418fa req-3c3f8ef8-e62d-4fb8-8297-b1059dcca33f service nova] Creating event network-changed:7124043d-665c-4a42-a041-b91ccc237b63 for instance 59fd26de-d46e-4f41-91f6-090005a07d99 on user Apr 17 10:34:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-523c0f54-34e0-4252-b60e-0629ab5418fa req-3c3f8ef8-e62d-4fb8-8297-b1059dcca33f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=72743) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 17 10:34:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-523c0f54-34e0-4252-b60e-0629ab5418fa req-3c3f8ef8-e62d-4fb8-8297-b1059dcca33f service nova] Acquired lock "compute-rpcapi-router" {{(pid=72743) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 17 10:34:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5dc9bb95-c752-4ed6-8338-fb45bd676ebe None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5dc9bb95-c752-4ed6-8338-fb45bd676ebe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5dc9bb95-c752-4ed6-8338-fb45bd676ebe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5dc9bb95-c752-4ed6-8338-fb45bd676ebe None None] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5dc9bb95-c752-4ed6-8338-fb45bd676ebe None None] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5dc9bb95-c752-4ed6-8338-fb45bd676ebe None None] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:42 user devstack@n-api.service[72743]: INFO nova.compute.rpcapi [None req-5dc9bb95-c752-4ed6-8338-fb45bd676ebe None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 17 10:34:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5dc9bb95-c752-4ed6-8338-fb45bd676ebe None None] Releasing lock "compute-rpcapi-router" {{(pid=72743) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 17 10:34:42 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-5dc9bb95-c752-4ed6-8338-fb45bd676ebe None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108226 Apr 17 10:34:42 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 33/101] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:34:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:43 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-149216570", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "networks": [{"uuid": "95203f9a-7934-486d-b36d-13d2317f1102"}], "security_groups": [{"name": "tempest-securitygroup--759934192"}], "key_name": "tempest-keypair-690522544", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:34:43 user devstack@n-api.service[72744]: DEBUG nova.network.neutron [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] validate_networks() for [('95203f9a-7934-486d-b36d-13d2317f1102', None, None, None, None, None)] {{(pid=72744) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:34:43 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-24256ddb-208c-4cfa-84d9-c26d0eebacb5 req-82d55d53-0664-433b-a721-664fb0fdf64f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60008675-7786-4a26-9640-49da6efd0adb", "name": "network-vif-plugged", "status": "completed", "tag": "d6e0e749-1043-40c1-8401-8aae219f3924"}, {"server_uuid": "6cc638ee-d494-4523-8d12-9ede0853ecd6", "name": "network-vif-plugged", "status": "completed", "tag": "d6ac6671-38e6-49a1-ba35-e903ffc15afa"}, {"server_uuid": "6cc638ee-d494-4523-8d12-9ede0853ecd6", "name": "network-vif-plugged", "status": "completed", "tag": "d6ac6671-38e6-49a1-ba35-e903ffc15afa"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:34:43 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-24256ddb-208c-4cfa-84d9-c26d0eebacb5 req-82d55d53-0664-433b-a721-664fb0fdf64f service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:43 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-24256ddb-208c-4cfa-84d9-c26d0eebacb5 req-82d55d53-0664-433b-a721-664fb0fdf64f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:43 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-24256ddb-208c-4cfa-84d9-c26d0eebacb5 req-82d55d53-0664-433b-a721-664fb0fdf64f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:43 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-24256ddb-208c-4cfa-84d9-c26d0eebacb5 req-82d55d53-0664-433b-a721-664fb0fdf64f service nova] Creating event network-vif-plugged:d6e0e749-1043-40c1-8401-8aae219f3924 for instance 60008675-7786-4a26-9640-49da6efd0adb on user Apr 17 10:34:43 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-24256ddb-208c-4cfa-84d9-c26d0eebacb5 req-82d55d53-0664-433b-a721-664fb0fdf64f service nova] Creating event network-vif-plugged:d6ac6671-38e6-49a1-ba35-e903ffc15afa for instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 on user Apr 17 10:34:43 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-24256ddb-208c-4cfa-84d9-c26d0eebacb5 req-82d55d53-0664-433b-a721-664fb0fdf64f service nova] Creating event network-vif-plugged:d6ac6671-38e6-49a1-ba35-e903ffc15afa for instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 on user Apr 17 10:34:43 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-24256ddb-208c-4cfa-84d9-c26d0eebacb5 req-82d55d53-0664-433b-a721-664fb0fdf64f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.081160 Apr 17 10:34:43 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 38/102] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:34:43 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:44 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Flavor limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:34:44 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Image limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:34:44 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Flavor pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:34:44 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Image pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:34:44 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:34:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:44 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Getting quotas for project 850462faec874544bdc01dd14746d558. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:34:44 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Getting quotas for user 282298df65264595b5d7351066128b1a and project 850462faec874544bdc01dd14746d558. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:34:44 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Going to run 1 instances... {{(pid=72744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:34:44 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:34:44 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-ecafd4fe-4018-414d-9c34-3f0ef3a91ce2 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.116420 Apr 17 10:34:44 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 32/103] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:34:43 2023] POST /compute/v2.1/servers => generated 403 bytes in 1120 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 10:34:44 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-cabc0e8f-59e4-4882-a182-4878ef1b0628 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:34:44 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-cabc0e8f-59e4-4882-a182-4878ef1b0628 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:34:44 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-cabc0e8f-59e4-4882-a182-4878ef1b0628 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282298df65264595b5d7351066128b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850462faec874544bdc01dd14746d558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:34:44 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-cabc0e8f-59e4-4882-a182-4878ef1b0628 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" status: 200 len: 1238 microversion: 2.1 time: 0.105620 Apr 17 10:34:44 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 34/104] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:34:44 2023] GET /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 => generated 1238 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:34:46 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-1554919c-ca53-4ffc-b9d6-d2eb877908b3 req-b82bfde2-a703-4839-b1a0-fdea2d692086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59fd26de-d46e-4f41-91f6-090005a07d99", "name": "network-vif-plugged", "status": "completed", "tag": "7124043d-665c-4a42-a041-b91ccc237b63"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:34:46 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-1554919c-ca53-4ffc-b9d6-d2eb877908b3 req-b82bfde2-a703-4839-b1a0-fdea2d692086 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:46 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-1554919c-ca53-4ffc-b9d6-d2eb877908b3 req-b82bfde2-a703-4839-b1a0-fdea2d692086 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:46 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-1554919c-ca53-4ffc-b9d6-d2eb877908b3 req-b82bfde2-a703-4839-b1a0-fdea2d692086 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:46 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-1554919c-ca53-4ffc-b9d6-d2eb877908b3 req-b82bfde2-a703-4839-b1a0-fdea2d692086 service nova] Creating event network-vif-plugged:7124043d-665c-4a42-a041-b91ccc237b63 for instance 59fd26de-d46e-4f41-91f6-090005a07d99 on user Apr 17 10:34:46 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-1554919c-ca53-4ffc-b9d6-d2eb877908b3 req-b82bfde2-a703-4839-b1a0-fdea2d692086 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063578 Apr 17 10:34:46 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 39/105] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:34:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 10:34:48 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-4aeccbbc-8b4a-4f51-a0a1-a48bbcb37a60 req-ce0165f0-a234-4655-b325-135ca56afb44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59fd26de-d46e-4f41-91f6-090005a07d99", "name": "network-vif-plugged", "status": "completed", "tag": "7124043d-665c-4a42-a041-b91ccc237b63"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:34:48 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-4aeccbbc-8b4a-4f51-a0a1-a48bbcb37a60 req-ce0165f0-a234-4655-b325-135ca56afb44 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:48 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-4aeccbbc-8b4a-4f51-a0a1-a48bbcb37a60 req-ce0165f0-a234-4655-b325-135ca56afb44 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:48 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-4aeccbbc-8b4a-4f51-a0a1-a48bbcb37a60 req-ce0165f0-a234-4655-b325-135ca56afb44 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:48 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-4aeccbbc-8b4a-4f51-a0a1-a48bbcb37a60 req-ce0165f0-a234-4655-b325-135ca56afb44 service nova] Creating event network-vif-plugged:7124043d-665c-4a42-a041-b91ccc237b63 for instance 59fd26de-d46e-4f41-91f6-090005a07d99 on user Apr 17 10:34:48 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-4aeccbbc-8b4a-4f51-a0a1-a48bbcb37a60 req-ce0165f0-a234-4655-b325-135ca56afb44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073974 Apr 17 10:34:48 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 33/106] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:34:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:49 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-1ed9fb1a-5446-4c24-b737-ae8a06dd29d7 req-560d5a17-f482-4be2-bd40-0f8ac9c5b509 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4315753-415c-45cd-b06f-da1e3ccc6e4d", "tag": "cd279a0c-99eb-4e32-876e-6d2208cc1db2"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:34:49 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-1ed9fb1a-5446-4c24-b737-ae8a06dd29d7 req-560d5a17-f482-4be2-bd40-0f8ac9c5b509 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:49 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-1ed9fb1a-5446-4c24-b737-ae8a06dd29d7 req-560d5a17-f482-4be2-bd40-0f8ac9c5b509 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:49 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-1ed9fb1a-5446-4c24-b737-ae8a06dd29d7 req-560d5a17-f482-4be2-bd40-0f8ac9c5b509 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:49 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-1ed9fb1a-5446-4c24-b737-ae8a06dd29d7 req-560d5a17-f482-4be2-bd40-0f8ac9c5b509 service nova] Creating event network-changed:cd279a0c-99eb-4e32-876e-6d2208cc1db2 for instance c4315753-415c-45cd-b06f-da1e3ccc6e4d on user Apr 17 10:34:49 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-1ed9fb1a-5446-4c24-b737-ae8a06dd29d7 req-560d5a17-f482-4be2-bd40-0f8ac9c5b509 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.232281 Apr 17 10:34:49 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 35/107] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:34:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:53 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-bc0c2ec4-98d0-4b69-bfa9-4156befb927e req-8a631a29-2575-4976-bf13-827f679299a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4315753-415c-45cd-b06f-da1e3ccc6e4d", "name": "network-vif-plugged", "status": "completed", "tag": "cd279a0c-99eb-4e32-876e-6d2208cc1db2"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:34:53 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:34:53 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=4 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:34:53 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-bc0c2ec4-98d0-4b69-bfa9-4156befb927e req-8a631a29-2575-4976-bf13-827f679299a2 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:53 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-bc0c2ec4-98d0-4b69-bfa9-4156befb927e req-8a631a29-2575-4976-bf13-827f679299a2 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:53 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-bc0c2ec4-98d0-4b69-bfa9-4156befb927e req-8a631a29-2575-4976-bf13-827f679299a2 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:53 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-bc0c2ec4-98d0-4b69-bfa9-4156befb927e req-8a631a29-2575-4976-bf13-827f679299a2 service nova] Creating event network-vif-plugged:cd279a0c-99eb-4e32-876e-6d2208cc1db2 for instance c4315753-415c-45cd-b06f-da1e3ccc6e4d on user Apr 17 10:34:53 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-bc0c2ec4-98d0-4b69-bfa9-4156befb927e req-8a631a29-2575-4976-bf13-827f679299a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041436 Apr 17 10:34:53 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 40/108] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:34:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:54 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=8 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:34:54 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=22 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:34:54 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-304c27aa-0a2a-48ab-a611-5c5001805823 req-92f8d548-9a38-42a6-924f-b319648c640d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4", "tag": "f839dea5-4294-4842-bfa2-262351dabfb9"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:34:54 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=9 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:34:54 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-304c27aa-0a2a-48ab-a611-5c5001805823 req-92f8d548-9a38-42a6-924f-b319648c640d service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:54 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-304c27aa-0a2a-48ab-a611-5c5001805823 req-92f8d548-9a38-42a6-924f-b319648c640d service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:54 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-304c27aa-0a2a-48ab-a611-5c5001805823 req-92f8d548-9a38-42a6-924f-b319648c640d service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:54 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=13 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:34:54 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-304c27aa-0a2a-48ab-a611-5c5001805823 req-92f8d548-9a38-42a6-924f-b319648c640d service nova] Creating event network-changed:f839dea5-4294-4842-bfa2-262351dabfb9 for instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 on user Apr 17 10:34:54 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-304c27aa-0a2a-48ab-a611-5c5001805823 req-92f8d548-9a38-42a6-924f-b319648c640d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139235 Apr 17 10:34:54 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 34/109] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:34:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:55 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=4 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:34:55 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=24 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:34:55 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-b7e66306-edfc-4425-9593-8fa9840fd8bd req-1c9edd04-3878-4deb-9c04-89227f18eddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4315753-415c-45cd-b06f-da1e3ccc6e4d", "name": "network-vif-plugged", "status": "completed", "tag": "cd279a0c-99eb-4e32-876e-6d2208cc1db2"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:34:55 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:34:55 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-b7e66306-edfc-4425-9593-8fa9840fd8bd req-1c9edd04-3878-4deb-9c04-89227f18eddb service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:55 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-b7e66306-edfc-4425-9593-8fa9840fd8bd req-1c9edd04-3878-4deb-9c04-89227f18eddb service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:55 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-b7e66306-edfc-4425-9593-8fa9840fd8bd req-1c9edd04-3878-4deb-9c04-89227f18eddb service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:55 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-b7e66306-edfc-4425-9593-8fa9840fd8bd req-1c9edd04-3878-4deb-9c04-89227f18eddb service nova] Creating event network-vif-plugged:cd279a0c-99eb-4e32-876e-6d2208cc1db2 for instance c4315753-415c-45cd-b06f-da1e3ccc6e4d on user Apr 17 10:34:55 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-b7e66306-edfc-4425-9593-8fa9840fd8bd req-1c9edd04-3878-4deb-9c04-89227f18eddb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046082 Apr 17 10:34:55 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 36/110] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:34:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:58 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-cf8fe929-ea13-475d-b2f5-47c11035e9d1 req-d7b4df0a-2528-4819-b3af-4696c3d03d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4", "name": "network-vif-plugged", "status": "completed", "tag": "f839dea5-4294-4842-bfa2-262351dabfb9"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:34:58 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-cf8fe929-ea13-475d-b2f5-47c11035e9d1 req-d7b4df0a-2528-4819-b3af-4696c3d03d0e service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:34:58 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-cf8fe929-ea13-475d-b2f5-47c11035e9d1 req-d7b4df0a-2528-4819-b3af-4696c3d03d0e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:34:58 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-cf8fe929-ea13-475d-b2f5-47c11035e9d1 req-d7b4df0a-2528-4819-b3af-4696c3d03d0e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:34:58 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-cf8fe929-ea13-475d-b2f5-47c11035e9d1 req-d7b4df0a-2528-4819-b3af-4696c3d03d0e service nova] Creating event network-vif-plugged:f839dea5-4294-4842-bfa2-262351dabfb9 for instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 on user Apr 17 10:34:58 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-cf8fe929-ea13-475d-b2f5-47c11035e9d1 req-d7b4df0a-2528-4819-b3af-4696c3d03d0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072471 Apr 17 10:34:58 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 41/111] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:34:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:34:58 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-80b883cf-3f4b-4b31-b14b-e8351256f2a7 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Action: 'create', calling method: .version_select at 0x7fc55ae892d0>, body: {"keypair": {"name": "tempest-keypair-1885421127", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKwzN5gZwJiLf7kL/Te58BS/o4Hp6lTpWXkF6oFUo6Fvuvh0VO0qHyTu9Tnn1hT7l4fXP9wTcKvNBSlIqYvAeBr+B6hcdfu7buddRuJa0QtQHU7hZJ7nWicTq8L7ShjNw=="}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:34:58 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-80b883cf-3f4b-4b31-b14b-e8351256f2a7 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Getting quotas for project 74ad2dd86dc14ead939b4fdca5a97a35. Resources: {'key_pairs'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:34:58 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-80b883cf-3f4b-4b31-b14b-e8351256f2a7 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Getting quotas for user c18c3804bb0449c8bba3b56df41ccc99 and project 74ad2dd86dc14ead939b4fdca5a97a35. Resources: {'key_pairs'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:34:58 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-80b883cf-3f4b-4b31-b14b-e8351256f2a7 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.176928 Apr 17 10:34:58 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 35/112] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 10:34:58 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:35:00 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-ae93c153-0084-4fe3-ae1d-1cdd2849243f tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Action: 'create', calling method: .version_select at 0x7fc55b658820>, body: {"keypair": {"name": "tempest-keypair-2120973316", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqZ/L6Z2Kpu64fEasPk05MYgGtpWeDJ254P2nPv61ccoonFszcT+uOvzrkLkO3pDSfAypS69UN5RLH0LaeaUpvK1JdPPzFtcQDbiz2XV5NbfAUmtLuHYK+SIu/wbWz9zw=="}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:35:00 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-ae93c153-0084-4fe3-ae1d-1cdd2849243f tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Getting quotas for project 50344f2e70ef48de8fbf64d408e61210. Resources: {'key_pairs'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:35:00 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-ae93c153-0084-4fe3-ae1d-1cdd2849243f tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Getting quotas for user 1a9df3167c7947aab20f7c2ef837fe92 and project 50344f2e70ef48de8fbf64d408e61210. Resources: {'key_pairs'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:35:00 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-ae93c153-0084-4fe3-ae1d-1cdd2849243f tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.554338 Apr 17 10:35:00 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 37/113] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 10:34:59 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:35:00 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-3204f614-23cf-4104-8f98-243469dd97c2 req-e1fa0640-291c-4805-9258-d609bac10347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4", "name": "network-vif-plugged", "status": "completed", "tag": "f839dea5-4294-4842-bfa2-262351dabfb9"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:35:00 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-3204f614-23cf-4104-8f98-243469dd97c2 req-e1fa0640-291c-4805-9258-d609bac10347 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:00 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-3204f614-23cf-4104-8f98-243469dd97c2 req-e1fa0640-291c-4805-9258-d609bac10347 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:00 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-3204f614-23cf-4104-8f98-243469dd97c2 req-e1fa0640-291c-4805-9258-d609bac10347 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:00 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-3204f614-23cf-4104-8f98-243469dd97c2 req-e1fa0640-291c-4805-9258-d609bac10347 service nova] Creating event network-vif-plugged:f839dea5-4294-4842-bfa2-262351dabfb9 for instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 on user Apr 17 10:35:00 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-3204f614-23cf-4104-8f98-243469dd97c2 req-e1fa0640-291c-4805-9258-d609bac10347 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041615 Apr 17 10:35:00 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 42/114] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:35:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:35:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-450067832", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "networks": [{"uuid": "25db3f74-3642-482d-8c0d-667e3cdf4e3c"}], "security_groups": [{"name": "tempest-securitygroup--57986356"}], "key_name": "tempest-keypair-1885421127", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:35:01 user devstack@n-api.service[72744]: DEBUG nova.network.neutron [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] validate_networks() for [('25db3f74-3642-482d-8c0d-667e3cdf4e3c', None, None, None, None, None)] {{(pid=72744) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:35:01 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Flavor limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:35:01 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Image limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:35:01 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Flavor pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:35:01 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Image pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:35:01 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:35:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:02 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Getting quotas for project 74ad2dd86dc14ead939b4fdca5a97a35. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:35:02 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Getting quotas for user c18c3804bb0449c8bba3b56df41ccc99 and project 74ad2dd86dc14ead939b4fdca5a97a35. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:35:02 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Going to run 1 instances... {{(pid=72744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:35:02 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:35:02 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-7ba2ed39-25c2-4d7a-b374-5ec81b99dd44 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.054090 Apr 17 10:35:02 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 36/115] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:35:01 2023] POST /compute/v2.1/servers => generated 402 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 10:35:02 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-1effd1ad-c996-4c11-8acd-40c6cafa65cd tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:35:02 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-1effd1ad-c996-4c11-8acd-40c6cafa65cd tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:35:02 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-1effd1ad-c996-4c11-8acd-40c6cafa65cd tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c3804bb0449c8bba3b56df41ccc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ad2dd86dc14ead939b4fdca5a97a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:35:02 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-1effd1ad-c996-4c11-8acd-40c6cafa65cd tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" status: 200 len: 1225 microversion: 2.1 time: 0.167142 Apr 17 10:35:02 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 38/116] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:35:02 2023] GET /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d => generated 1225 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:35:02 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-341764488", "imageRef": "ba2509ee-798b-4a36-b711-51a9b4dc7e2c", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "c223b63d-e8a2-4312-ab68-1bec24248b1d"}], "security_groups": [{"name": "tempest-securitygroup--1719881674"}], "key_name": "tempest-keypair-2120973316", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:35:02 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:35:03 user devstack@n-api.service[72745]: DEBUG nova.network.neutron [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] validate_networks() for [('c223b63d-e8a2-4312-ab68-1bec24248b1d', None, None, None, None, None)] {{(pid=72745) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:35:03 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Flavor limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:35:03 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Image limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:35:03 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Flavor pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:35:03 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Image pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:35:03 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:35:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:03 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=19 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:35:03 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Getting quotas for project 50344f2e70ef48de8fbf64d408e61210. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:35:03 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Getting quotas for user 1a9df3167c7947aab20f7c2ef837fe92 and project 50344f2e70ef48de8fbf64d408e61210. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:35:03 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Going to run 1 instances... {{(pid=72745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:35:03 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ba2509ee-798b-4a36-b711-51a9b4dc7e2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:35:03 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-22150bc3-2b49-40b0-a67d-9268ce1e76a1 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.797780 Apr 17 10:35:03 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 43/117] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:35:02 2023] POST /compute/v2.1/servers => generated 404 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 10:35:03 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-13504e0e-bd3d-4cf9-b834-130746aad24f tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:35:03 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-13504e0e-bd3d-4cf9-b834-130746aad24f tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:35:03 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-13504e0e-bd3d-4cf9-b834-130746aad24f tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a9df3167c7947aab20f7c2ef837fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50344f2e70ef48de8fbf64d408e61210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:35:03 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-13504e0e-bd3d-4cf9-b834-130746aad24f tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" status: 200 len: 1239 microversion: 2.1 time: 0.147404 Apr 17 10:35:03 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 37/118] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:35:03 2023] GET /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab => generated 1239 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:35:06 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-e4c485c9-3b22-4b7f-b8e8-377a3ba8c95f req-f7931d18-5d5e-472f-856f-f432df1675b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d", "tag": "01527ff5-7a84-4bbf-ae89-ef334a97fc0a"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:35:06 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=10 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:35:06 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-e4c485c9-3b22-4b7f-b8e8-377a3ba8c95f req-f7931d18-5d5e-472f-856f-f432df1675b5 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:06 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-e4c485c9-3b22-4b7f-b8e8-377a3ba8c95f req-f7931d18-5d5e-472f-856f-f432df1675b5 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:06 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-e4c485c9-3b22-4b7f-b8e8-377a3ba8c95f req-f7931d18-5d5e-472f-856f-f432df1675b5 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:06 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-e4c485c9-3b22-4b7f-b8e8-377a3ba8c95f req-f7931d18-5d5e-472f-856f-f432df1675b5 service nova] Creating event network-changed:01527ff5-7a84-4bbf-ae89-ef334a97fc0a for instance 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d on user Apr 17 10:35:06 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-e4c485c9-3b22-4b7f-b8e8-377a3ba8c95f req-f7931d18-5d5e-472f-856f-f432df1675b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073058 Apr 17 10:35:06 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 39/119] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:35:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:35:09 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-98a95e23-0f1a-40a3-910f-3ae3b00a6d65 req-ffda5629-62af-4d69-b4c1-ef2d1e552ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab", "tag": "6289bf49-e33d-4ce9-bac7-376417d7abb8"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:35:09 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-98a95e23-0f1a-40a3-910f-3ae3b00a6d65 req-ffda5629-62af-4d69-b4c1-ef2d1e552ae7 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:09 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-98a95e23-0f1a-40a3-910f-3ae3b00a6d65 req-ffda5629-62af-4d69-b4c1-ef2d1e552ae7 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:09 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-98a95e23-0f1a-40a3-910f-3ae3b00a6d65 req-ffda5629-62af-4d69-b4c1-ef2d1e552ae7 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:09 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-98a95e23-0f1a-40a3-910f-3ae3b00a6d65 req-ffda5629-62af-4d69-b4c1-ef2d1e552ae7 service nova] Creating event network-changed:6289bf49-e33d-4ce9-bac7-376417d7abb8 for instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab on user Apr 17 10:35:09 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-98a95e23-0f1a-40a3-910f-3ae3b00a6d65 req-ffda5629-62af-4d69-b4c1-ef2d1e552ae7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073104 Apr 17 10:35:09 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 44/120] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:35:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:35:11 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-c89b713e-2a16-4323-b2c5-8e181968bc8d req-8c34b956-031d-42e5-b48f-7adbdd68e477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d", "name": "network-vif-plugged", "status": "completed", "tag": "01527ff5-7a84-4bbf-ae89-ef334a97fc0a"}, {"server_uuid": "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d", "name": "network-vif-plugged", "status": "completed", "tag": "01527ff5-7a84-4bbf-ae89-ef334a97fc0a"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:35:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-c89b713e-2a16-4323-b2c5-8e181968bc8d req-8c34b956-031d-42e5-b48f-7adbdd68e477 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-c89b713e-2a16-4323-b2c5-8e181968bc8d req-8c34b956-031d-42e5-b48f-7adbdd68e477 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-c89b713e-2a16-4323-b2c5-8e181968bc8d req-8c34b956-031d-42e5-b48f-7adbdd68e477 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-c89b713e-2a16-4323-b2c5-8e181968bc8d req-8c34b956-031d-42e5-b48f-7adbdd68e477 service nova] Creating event network-vif-plugged:01527ff5-7a84-4bbf-ae89-ef334a97fc0a for instance 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d on user Apr 17 10:35:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-c89b713e-2a16-4323-b2c5-8e181968bc8d req-8c34b956-031d-42e5-b48f-7adbdd68e477 service nova] Creating event network-vif-plugged:01527ff5-7a84-4bbf-ae89-ef334a97fc0a for instance 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d on user Apr 17 10:35:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-c89b713e-2a16-4323-b2c5-8e181968bc8d req-8c34b956-031d-42e5-b48f-7adbdd68e477 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048510 Apr 17 10:35:11 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 38/121] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:35:11 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:35:12 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:35:12 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-184b5172-b28e-47ef-8a40-ff67f01bdad5 req-65b13627-6f2b-433c-be1a-ef8340c64b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab", "name": "network-vif-plugged", "status": "completed", "tag": "6289bf49-e33d-4ce9-bac7-376417d7abb8"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:35:12 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-184b5172-b28e-47ef-8a40-ff67f01bdad5 req-65b13627-6f2b-433c-be1a-ef8340c64b46 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:12 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-184b5172-b28e-47ef-8a40-ff67f01bdad5 req-65b13627-6f2b-433c-be1a-ef8340c64b46 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:12 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-184b5172-b28e-47ef-8a40-ff67f01bdad5 req-65b13627-6f2b-433c-be1a-ef8340c64b46 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:12 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-184b5172-b28e-47ef-8a40-ff67f01bdad5 req-65b13627-6f2b-433c-be1a-ef8340c64b46 service nova] Creating event network-vif-plugged:6289bf49-e33d-4ce9-bac7-376417d7abb8 for instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab on user Apr 17 10:35:12 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-184b5172-b28e-47ef-8a40-ff67f01bdad5 req-65b13627-6f2b-433c-be1a-ef8340c64b46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059036 Apr 17 10:35:12 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 40/122] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:35:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:35:14 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:35:14 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:35:14 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-04b3899a-ea37-45f4-9501-f16725b6bac8 req-a0ab48b7-bd8b-4db0-8400-39dec5d8f72b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab", "name": "network-vif-plugged", "status": "completed", "tag": "6289bf49-e33d-4ce9-bac7-376417d7abb8"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:35:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-04b3899a-ea37-45f4-9501-f16725b6bac8 req-a0ab48b7-bd8b-4db0-8400-39dec5d8f72b service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-04b3899a-ea37-45f4-9501-f16725b6bac8 req-a0ab48b7-bd8b-4db0-8400-39dec5d8f72b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-04b3899a-ea37-45f4-9501-f16725b6bac8 req-a0ab48b7-bd8b-4db0-8400-39dec5d8f72b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:14 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-04b3899a-ea37-45f4-9501-f16725b6bac8 req-a0ab48b7-bd8b-4db0-8400-39dec5d8f72b service nova] Creating event network-vif-plugged:6289bf49-e33d-4ce9-bac7-376417d7abb8 for instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab on user Apr 17 10:35:14 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-04b3899a-ea37-45f4-9501-f16725b6bac8 req-a0ab48b7-bd8b-4db0-8400-39dec5d8f72b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077497 Apr 17 10:35:14 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 45/123] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:35:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:35:19 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:35:19 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=12 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:35:19 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-fe3691ad-12a7-44bf-b5f8-77f5d3b39185 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:35:19 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-fe3691ad-12a7-44bf-b5f8-77f5d3b39185 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:35:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-fe3691ad-12a7-44bf-b5f8-77f5d3b39185 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-fe3691ad-12a7-44bf-b5f8-77f5d3b39185 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-fe3691ad-12a7-44bf-b5f8-77f5d3b39185 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-fe3691ad-12a7-44bf-b5f8-77f5d3b39185 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-fe3691ad-12a7-44bf-b5f8-77f5d3b39185 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-fe3691ad-12a7-44bf-b5f8-77f5d3b39185 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:19 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-fe3691ad-12a7-44bf-b5f8-77f5d3b39185 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:35:19 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-fe3691ad-12a7-44bf-b5f8-77f5d3b39185 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:35:19 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-fe3691ad-12a7-44bf-b5f8-77f5d3b39185 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:35:19 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-fe3691ad-12a7-44bf-b5f8-77f5d3b39185 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/60008675-7786-4a26-9640-49da6efd0adb" status: 200 len: 1690 microversion: 2.87 time: 0.594349 Apr 17 10:35:19 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 39/124] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:35:19 2023] GET /compute/v2.1/servers/60008675-7786-4a26-9640-49da6efd0adb => generated 1690 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:35:21 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-ae29d236-d27c-40e6-9388-287ceb48af6c tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Action: 'create', calling method: .version_select at 0x7fc55b65a200>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-645097723", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUy/ajstR9aQT2gkuOvucvRJeGg6vK7qK026KNm5Gtty8ym+LC1rRh/ZX81MNLHA7IhoKTr9dTq2LhqisMnOl79ug8UDsCxHekgGAl/F8lBsqTKCw+eY6QDhUlNTWsIWA=="}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:35:21 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-ae29d236-d27c-40e6-9388-287ceb48af6c tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Getting quotas for project df0c657dc95549a3a3ce94f35bfa91be. Resources: {'key_pairs'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:35:21 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-ae29d236-d27c-40e6-9388-287ceb48af6c tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Getting quotas for user ea177954e75a45f7ad7c9831ab55375a and project df0c657dc95549a3a3ce94f35bfa91be. Resources: {'key_pairs'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:35:21 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-ae29d236-d27c-40e6-9388-287ceb48af6c tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.282748 Apr 17 10:35:21 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 41/125] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 10:35:20 2023] POST /compute/v2.1/os-keypairs => generated 404 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:35:22 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-6af1ca30-bd31-48f0-9b30-2deab4c87dda tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:35:22 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-6af1ca30-bd31-48f0-9b30-2deab4c87dda tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:35:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6af1ca30-bd31-48f0-9b30-2deab4c87dda tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6af1ca30-bd31-48f0-9b30-2deab4c87dda tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6af1ca30-bd31-48f0-9b30-2deab4c87dda tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6af1ca30-bd31-48f0-9b30-2deab4c87dda tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6af1ca30-bd31-48f0-9b30-2deab4c87dda tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6af1ca30-bd31-48f0-9b30-2deab4c87dda tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:22 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-3983057", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-645097723", "security_groups": [{"name": "tempest-secgroup-smoke-721936281"}], "networks": [{"uuid": "048217be-c7b8-4f65-a379-f4a8f0f18055"}]}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:35:23 user devstack@n-api.service[72744]: DEBUG nova.network.neutron [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] validate_networks() for [('048217be-c7b8-4f65-a379-f4a8f0f18055', None, None, None, None, None)] {{(pid=72744) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:35:23 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-6af1ca30-bd31-48f0-9b30-2deab4c87dda tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4863ef9d61412a997abf4f27cce1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02daa1fd267646fbb4f726b247ba4a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:35:23 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-6af1ca30-bd31-48f0-9b30-2deab4c87dda tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cc638ee-d494-4523-8d12-9ede0853ecd6" status: 200 len: 1490 microversion: 2.1 time: 0.612501 Apr 17 10:35:23 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 46/126] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:35:22 2023] GET /compute/v2.1/servers/6cc638ee-d494-4523-8d12-9ede0853ecd6 => generated 1490 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:35:23 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Flavor limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:35:23 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Image limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:35:23 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Flavor pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:35:23 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Image pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:35:23 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:35:23 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:23 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:23 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:23 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:23 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:23 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:23 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Getting quotas for project df0c657dc95549a3a3ce94f35bfa91be. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:35:23 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Getting quotas for user ea177954e75a45f7ad7c9831ab55375a and project df0c657dc95549a3a3ce94f35bfa91be. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:35:23 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Going to run 1 instances... {{(pid=72744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:35:23 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:35:23 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-47c426da-088c-4320-af76-afc44688d760 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.037997 Apr 17 10:35:23 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 40/127] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:35:22 2023] POST /compute/v2.1/servers => generated 403 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 10:35:23 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=4 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:35:23 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-25939fe2-d932-4006-a482-662459563386 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:35:23 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-25939fe2-d932-4006-a482-662459563386 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:35:23 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-25939fe2-d932-4006-a482-662459563386 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea177954e75a45f7ad7c9831ab55375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0c657dc95549a3a3ce94f35bfa91be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:35:23 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-25939fe2-d932-4006-a482-662459563386 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735" status: 200 len: 1253 microversion: 2.1 time: 0.101025 Apr 17 10:35:23 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 42/128] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:35:23 2023] GET /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735 => generated 1253 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:35:27 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-0648e6f8-92ad-42af-ac0b-2a602383ac7a tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:35:27 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-0648e6f8-92ad-42af-ac0b-2a602383ac7a tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:35:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0648e6f8-92ad-42af-ac0b-2a602383ac7a tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0648e6f8-92ad-42af-ac0b-2a602383ac7a tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0648e6f8-92ad-42af-ac0b-2a602383ac7a tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0648e6f8-92ad-42af-ac0b-2a602383ac7a tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0648e6f8-92ad-42af-ac0b-2a602383ac7a tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0648e6f8-92ad-42af-ac0b-2a602383ac7a tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:28 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-d776dc19-d14c-436a-80c2-8e59e107dca9 req-d6102d29-d176-4002-a10d-1cc982ed80bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7792cf72-dc73-4201-9501-4515ce860735", "tag": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:35:28 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=7 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:35:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-d776dc19-d14c-436a-80c2-8e59e107dca9 req-d6102d29-d176-4002-a10d-1cc982ed80bd service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-d776dc19-d14c-436a-80c2-8e59e107dca9 req-d6102d29-d176-4002-a10d-1cc982ed80bd service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-d776dc19-d14c-436a-80c2-8e59e107dca9 req-d6102d29-d176-4002-a10d-1cc982ed80bd service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:28 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=14 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:35:28 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-d776dc19-d14c-436a-80c2-8e59e107dca9 req-d6102d29-d176-4002-a10d-1cc982ed80bd service nova] Creating event network-changed:7d50333e-fed3-47d0-9aaf-bd1ab7238d62 for instance 7792cf72-dc73-4201-9501-4515ce860735 on user Apr 17 10:35:28 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-d776dc19-d14c-436a-80c2-8e59e107dca9 req-d6102d29-d176-4002-a10d-1cc982ed80bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050081 Apr 17 10:35:28 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 41/129] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:35:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:35:28 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-0648e6f8-92ad-42af-ac0b-2a602383ac7a tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9862432f87f4500a46f32a0b27d54d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a17ec3e1b314acbb701f2d2d27d0560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:35:28 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-0648e6f8-92ad-42af-ac0b-2a602383ac7a tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99" status: 200 len: 1534 microversion: 2.1 time: 0.637187 Apr 17 10:35:28 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 47/130] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:35:27 2023] GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99 => generated 1534 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:35:30 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-68929c21-8832-40e9-b4f9-0445ea27a8d8 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Action: 'create', calling method: .version_select at 0x7fc55b658700>, body: {"keypair": {"name": "tempest-keypair-2090401125", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPynuxHW9zZGibQyfPrMDYTXn2ecie+Gedjl+wMjgN8hOlzg6TbmWlHIpw+FoCMEVliPM9HJbe1xxCPmykCrgtYnwuEb3db3p/+32h+sFpqxCWEE6rOcEDmIe287S5ZX6g=="}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:35:30 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:35:30 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-68929c21-8832-40e9-b4f9-0445ea27a8d8 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Getting quotas for project a553d324884a4e5785c896d76b2a9376. Resources: {'key_pairs'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:35:30 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-68929c21-8832-40e9-b4f9-0445ea27a8d8 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Getting quotas for user 41eaa1a7dc224ec4bd8ebd5fdef1fbeb and project a553d324884a4e5785c896d76b2a9376. Resources: {'key_pairs'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:35:30 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-68929c21-8832-40e9-b4f9-0445ea27a8d8 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.075206 Apr 17 10:35:30 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 43/131] 10.0.0.210 () {66 vars in 1277 bytes} [Mon Apr 17 10:35:30 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 76 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 17 10:35:30 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-41198e54-f942-4fc8-89aa-232a2fdcdedf tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:35:30 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-41198e54-f942-4fc8-89aa-232a2fdcdedf tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:35:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-41198e54-f942-4fc8-89aa-232a2fdcdedf tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-41198e54-f942-4fc8-89aa-232a2fdcdedf tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-41198e54-f942-4fc8-89aa-232a2fdcdedf tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-41198e54-f942-4fc8-89aa-232a2fdcdedf tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-41198e54-f942-4fc8-89aa-232a2fdcdedf tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-41198e54-f942-4fc8-89aa-232a2fdcdedf tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:30 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-7d284954-6995-4dbb-bc28-3a2268f8778c req-ed37e5cb-21e8-4823-b7e8-c4928473fadc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7792cf72-dc73-4201-9501-4515ce860735", "name": "network-vif-plugged", "status": "completed", "tag": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:35:30 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-7d284954-6995-4dbb-bc28-3a2268f8778c req-ed37e5cb-21e8-4823-b7e8-c4928473fadc service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:30 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-7d284954-6995-4dbb-bc28-3a2268f8778c req-ed37e5cb-21e8-4823-b7e8-c4928473fadc service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:30 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-7d284954-6995-4dbb-bc28-3a2268f8778c req-ed37e5cb-21e8-4823-b7e8-c4928473fadc service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:30 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-7d284954-6995-4dbb-bc28-3a2268f8778c req-ed37e5cb-21e8-4823-b7e8-c4928473fadc service nova] Creating event network-vif-plugged:7d50333e-fed3-47d0-9aaf-bd1ab7238d62 for instance 7792cf72-dc73-4201-9501-4515ce860735 on user Apr 17 10:35:30 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-7d284954-6995-4dbb-bc28-3a2268f8778c req-ed37e5cb-21e8-4823-b7e8-c4928473fadc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063812 Apr 17 10:35:30 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 48/132] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:35:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:35:31 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-ff390df6-b07c-414b-bfc1-1c1277599750 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Action: 'create', calling method: .version_select at 0x7fc55b65aa70>, body: {"keypair": {"name": "tempest-keypair-1616755361", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn1adWmwlMWL8uuJGfYvNmaOxHCFY9boQnJT3ZgeKq6xHDA59cpKXNqWDTjwYUaWTaBYTif8gbd5iYCw0GHFy0rW+WTO7REtN20OamQAGZDPjmCnvFh2P1ugCWbuHVc5Q=="}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:35:31 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-ff390df6-b07c-414b-bfc1-1c1277599750 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Getting quotas for project c5c3233510fa4ef1bb876bd6ee37a443. Resources: {'key_pairs'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:35:31 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-ff390df6-b07c-414b-bfc1-1c1277599750 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Getting quotas for user 245581ebc4824aa7addd4d4272d4a47d and project c5c3233510fa4ef1bb876bd6ee37a443. Resources: {'key_pairs'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:35:31 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-ff390df6-b07c-414b-bfc1-1c1277599750 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.047108 Apr 17 10:35:31 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 44/133] 10.0.0.210 () {66 vars in 1277 bytes} [Mon Apr 17 10:35:31 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 17 10:35:31 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-41198e54-f942-4fc8-89aa-232a2fdcdedf tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:35:31 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-41198e54-f942-4fc8-89aa-232a2fdcdedf tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:35:31 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-41198e54-f942-4fc8-89aa-232a2fdcdedf tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:35:31 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-41198e54-f942-4fc8-89aa-232a2fdcdedf tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d" status: 200 len: 1583 microversion: 2.20 time: 0.703813 Apr 17 10:35:31 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 42/134] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:35:30 2023] GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d => generated 1583 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:35:32 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-154424156", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "6256e79c-cac6-4326-ab0a-322a4d5c61f3"}, {"port": "03ae70e4-ee40-4b09-a38b-a819ee74d880", "tag": "port-1"}, {"port": "77da47f6-f251-457d-b4c9-a2687922abc5", "tag": "port-2"}, {"uuid": "8bad3f52-f1e9-4477-a5af-235be277d5fc", "tag": "net-1"}, {"uuid": "8bad3f52-f1e9-4477-a5af-235be277d5fc"}, {"uuid": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "0ec736fc-747d-4ae4-a8c2-cd45c718cf1e", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "9c283ca4-fc93-4f5f-ba1d-3190871dea02", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "46647c48-1076-472f-90b1-7e19985bfa7e", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "8cf5c72f-e6de-4173-b335-076e979303d7", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--889751045"}], "key_name": "tempest-keypair-2090401125", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:35:32 user devstack@n-api.service[72745]: DEBUG nova.network.neutron [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] validate_networks() for [('6256e79c-cac6-4326-ab0a-322a4d5c61f3', None, None, None, None, None), (None, None, '03ae70e4-ee40-4b09-a38b-a819ee74d880', None, None, None), (None, None, '77da47f6-f251-457d-b4c9-a2687922abc5', None, None, None), ('8bad3f52-f1e9-4477-a5af-235be277d5fc', None, None, None, None, None), ('8bad3f52-f1e9-4477-a5af-235be277d5fc', None, None, None, None, None), ('0ec736fc-747d-4ae4-a8c2-cd45c718cf1e', '10.2.2.100', None, None, None, None), ('0ec736fc-747d-4ae4-a8c2-cd45c718cf1e', '10.2.2.200', None, None, None, None)] {{(pid=72745) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:35:32 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-238332109", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "ab4771c2-e461-463d-9c08-c52f0fa689d7"}, {"port": "5ead9709-8869-4070-81f0-1e397c5ba789", "tag": "port-1"}, {"port": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8", "tag": "port-2"}, {"uuid": "07734509-5069-44dc-8e4b-1c83d4b01c43", "tag": "net-1"}, {"uuid": "07734509-5069-44dc-8e4b-1c83d4b01c43"}, {"uuid": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "595a5463-db90-4c81-8ed2-6e5e2f918cfe", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "1b078c60-dd3a-40a5-b5cf-61f0546b7021", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "2e23bb78-786c-40bf-abd6-6ab77d4ed569", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "7fb93d4e-544e-4909-9b87-72ea32bd3e15", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--359857343"}], "key_name": "tempest-keypair-1616755361", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:35:32 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-00c39d67-5141-4703-aad9-e3397f6fe87e req-3e882bc0-197a-498e-bed6-6be3a891af67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7792cf72-dc73-4201-9501-4515ce860735", "name": "network-vif-plugged", "status": "completed", "tag": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:35:32 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-00c39d67-5141-4703-aad9-e3397f6fe87e req-3e882bc0-197a-498e-bed6-6be3a891af67 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:32 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-00c39d67-5141-4703-aad9-e3397f6fe87e req-3e882bc0-197a-498e-bed6-6be3a891af67 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:32 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-00c39d67-5141-4703-aad9-e3397f6fe87e req-3e882bc0-197a-498e-bed6-6be3a891af67 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:32 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-00c39d67-5141-4703-aad9-e3397f6fe87e req-3e882bc0-197a-498e-bed6-6be3a891af67 service nova] Creating event network-vif-plugged:7d50333e-fed3-47d0-9aaf-bd1ab7238d62 for instance 7792cf72-dc73-4201-9501-4515ce860735 on user Apr 17 10:35:32 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-00c39d67-5141-4703-aad9-e3397f6fe87e req-3e882bc0-197a-498e-bed6-6be3a891af67 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049590 Apr 17 10:35:32 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 43/135] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:35:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:35:32 user devstack@n-api.service[72743]: DEBUG nova.network.neutron [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] validate_networks() for [('ab4771c2-e461-463d-9c08-c52f0fa689d7', None, None, None, None, None), (None, None, '5ead9709-8869-4070-81f0-1e397c5ba789', None, None, None), (None, None, 'b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8', None, None, None), ('07734509-5069-44dc-8e4b-1c83d4b01c43', None, None, None, None, None), ('07734509-5069-44dc-8e4b-1c83d4b01c43', None, None, None, None, None), ('595a5463-db90-4c81-8ed2-6e5e2f918cfe', '10.2.2.100', None, None, None, None), ('595a5463-db90-4c81-8ed2-6e5e2f918cfe', '10.2.2.200', None, None, None, None)] {{(pid=72743) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:35:33 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:35:34 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Flavor limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:35:34 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Image limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:35:34 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Flavor pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:35:34 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Image pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:35:34 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:35:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:34 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=20 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:35:34 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Getting quotas for project a553d324884a4e5785c896d76b2a9376. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:35:34 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Getting quotas for user 41eaa1a7dc224ec4bd8ebd5fdef1fbeb and project a553d324884a4e5785c896d76b2a9376. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:35:34 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Going to run 1 instances... {{(pid=72745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:35:34 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='9c283ca4-fc93-4f5f-ba1d-3190871dea02',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='46647c48-1076-472f-90b1-7e19985bfa7e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8cf5c72f-e6de-4173-b335-076e979303d7',volume_size=None,volume_type=None)] {{(pid=72745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:35:34 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:35:34 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:35:34 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-56e288b5-03ed-41eb-9a3e-f58537c4dfb8 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:35:34 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-56e288b5-03ed-41eb-9a3e-f58537c4dfb8 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:35:34 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-56e288b5-03ed-41eb-9a3e-f58537c4dfb8 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:34 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-56e288b5-03ed-41eb-9a3e-f58537c4dfb8 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:34 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-56e288b5-03ed-41eb-9a3e-f58537c4dfb8 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:34 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-56e288b5-03ed-41eb-9a3e-f58537c4dfb8 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:34 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-56e288b5-03ed-41eb-9a3e-f58537c4dfb8 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:34 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-56e288b5-03ed-41eb-9a3e-f58537c4dfb8 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:35 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-e35ff65e-b54a-4311-93fc-5d44a607f314 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.32 time: 3.049471 Apr 17 10:35:35 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 49/136] 10.0.0.210 () {66 vars in 1266 bytes} [Mon Apr 17 10:35:32 2023] POST /compute/v2.1/servers => generated 403 bytes in 3051 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 17 10:35:35 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-1baa58ea-2123-4a43-a502-e73f3b449d5b tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:35:35 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-1baa58ea-2123-4a43-a502-e73f3b449d5b tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:35:35 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-1baa58ea-2123-4a43-a502-e73f3b449d5b tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa1a7dc224ec4bd8ebd5fdef1fbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d324884a4e5785c896d76b2a9376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:35:35 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-1baa58ea-2123-4a43-a502-e73f3b449d5b tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41eaa1a7dc224ec4bd8ebd5fdef1fbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d324884a4e5785c896d76b2a9376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:35:35 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-1baa58ea-2123-4a43-a502-e73f3b449d5b tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41eaa1a7dc224ec4bd8ebd5fdef1fbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d324884a4e5785c896d76b2a9376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:35:35 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-1baa58ea-2123-4a43-a502-e73f3b449d5b tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] 10.0.0.210 "GET /compute/v2.1/servers/250f2cd2-b6ba-4a89-921f-cbd21ac36525" status: 200 len: 1279 microversion: 2.32 time: 0.081638 Apr 17 10:35:35 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 50/137] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:35:35 2023] GET /compute/v2.1/servers/250f2cd2-b6ba-4a89-921f-cbd21ac36525 => generated 1279 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 17 10:35:35 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-56e288b5-03ed-41eb-9a3e-f58537c4dfb8 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282298df65264595b5d7351066128b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850462faec874544bdc01dd14746d558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:35:35 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-56e288b5-03ed-41eb-9a3e-f58537c4dfb8 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" status: 200 len: 1551 microversion: 2.1 time: 0.556336 Apr 17 10:35:35 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 44/138] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:35:34 2023] GET /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 => generated 1551 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:35:35 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Flavor limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:35:35 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Image limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:35:35 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Flavor pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:35:35 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Image pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:35:35 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:35:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:35 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Getting quotas for project c5c3233510fa4ef1bb876bd6ee37a443. Resources: {'cores', 'instances', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:35:35 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Getting quotas for user 245581ebc4824aa7addd4d4272d4a47d and project c5c3233510fa4ef1bb876bd6ee37a443. Resources: {'cores', 'instances', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:35:35 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Going to run 1 instances... {{(pid=72743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:35:35 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='1b078c60-dd3a-40a5-b5cf-61f0546b7021',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='2e23bb78-786c-40bf-abd6-6ab77d4ed569',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7fb93d4e-544e-4909-9b87-72ea32bd3e15',volume_size=None,volume_type=None)] {{(pid=72743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:35:36 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-4ac14fb8-0c71-4075-a503-9e4be0f8e435 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.42 time: 3.632092 Apr 17 10:35:36 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 45/139] 10.0.0.210 () {66 vars in 1266 bytes} [Mon Apr 17 10:35:32 2023] POST /compute/v2.1/servers => generated 403 bytes in 3633 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 17 10:35:36 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-c53ff894-2037-4560-8e69-20a870578c1b tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:35:36 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-c53ff894-2037-4560-8e69-20a870578c1b tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:35:36 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-c53ff894-2037-4560-8e69-20a870578c1b tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245581ebc4824aa7addd4d4272d4a47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c3233510fa4ef1bb876bd6ee37a443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:35:36 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-c53ff894-2037-4560-8e69-20a870578c1b tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245581ebc4824aa7addd4d4272d4a47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c3233510fa4ef1bb876bd6ee37a443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:35:36 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-c53ff894-2037-4560-8e69-20a870578c1b tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245581ebc4824aa7addd4d4272d4a47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c3233510fa4ef1bb876bd6ee37a443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:35:36 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-c53ff894-2037-4560-8e69-20a870578c1b tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f120f04-ecbf-496e-81c9-dcfed9084064" status: 200 len: 1279 microversion: 2.42 time: 0.107885 Apr 17 10:35:36 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 51/140] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:35:36 2023] GET /compute/v2.1/servers/1f120f04-ecbf-496e-81c9-dcfed9084064 => generated 1279 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:35:41 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-87ae52d4-c290-4ad7-ab4b-94c57a7a5d5e req-ea989df2-1b80-4102-88f4-4ec42992f2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "tag": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:35:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-87ae52d4-c290-4ad7-ab4b-94c57a7a5d5e req-ea989df2-1b80-4102-88f4-4ec42992f2f5 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-87ae52d4-c290-4ad7-ab4b-94c57a7a5d5e req-ea989df2-1b80-4102-88f4-4ec42992f2f5 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-87ae52d4-c290-4ad7-ab4b-94c57a7a5d5e req-ea989df2-1b80-4102-88f4-4ec42992f2f5 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:41 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-87ae52d4-c290-4ad7-ab4b-94c57a7a5d5e req-ea989df2-1b80-4102-88f4-4ec42992f2f5 service nova] Creating event network-changed:4ea57433-f4d1-4edf-ac36-c8099ce1cd8e for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:35:41 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-87ae52d4-c290-4ad7-ab4b-94c57a7a5d5e req-ea989df2-1b80-4102-88f4-4ec42992f2f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043810 Apr 17 10:35:41 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 45/141] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:35:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:35:42 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-4d87de4f-55ff-4bda-a06f-90c85e792450 req-46b9866e-0e61-411a-a55e-98d53db0b21a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "tag": "acaf0b67-4938-4a01-ac74-86f0935046eb"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:35:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-4d87de4f-55ff-4bda-a06f-90c85e792450 req-46b9866e-0e61-411a-a55e-98d53db0b21a service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-4d87de4f-55ff-4bda-a06f-90c85e792450 req-46b9866e-0e61-411a-a55e-98d53db0b21a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-4d87de4f-55ff-4bda-a06f-90c85e792450 req-46b9866e-0e61-411a-a55e-98d53db0b21a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:42 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-4d87de4f-55ff-4bda-a06f-90c85e792450 req-46b9866e-0e61-411a-a55e-98d53db0b21a service nova] Creating event network-changed:acaf0b67-4938-4a01-ac74-86f0935046eb for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:35:42 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-4d87de4f-55ff-4bda-a06f-90c85e792450 req-46b9866e-0e61-411a-a55e-98d53db0b21a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038553 Apr 17 10:35:42 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 46/142] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:35:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 10:35:43 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-7ec41392-b99d-42f2-881b-8838ae9dc9ff req-b2d11fd6-70b3-4d74-ba8f-2f02141cbaac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "tag": "03ae70e4-ee40-4b09-a38b-a819ee74d880"}, {"name": "network-changed", "server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "tag": "77da47f6-f251-457d-b4c9-a2687922abc5"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:35:43 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-7ec41392-b99d-42f2-881b-8838ae9dc9ff req-b2d11fd6-70b3-4d74-ba8f-2f02141cbaac service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:43 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-7ec41392-b99d-42f2-881b-8838ae9dc9ff req-b2d11fd6-70b3-4d74-ba8f-2f02141cbaac service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:43 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-7ec41392-b99d-42f2-881b-8838ae9dc9ff req-b2d11fd6-70b3-4d74-ba8f-2f02141cbaac service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:43 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-7ec41392-b99d-42f2-881b-8838ae9dc9ff req-b2d11fd6-70b3-4d74-ba8f-2f02141cbaac service nova] Creating event network-changed:03ae70e4-ee40-4b09-a38b-a819ee74d880 for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:35:43 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-7ec41392-b99d-42f2-881b-8838ae9dc9ff req-b2d11fd6-70b3-4d74-ba8f-2f02141cbaac service nova] Creating event network-changed:77da47f6-f251-457d-b4c9-a2687922abc5 for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:35:43 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-7ec41392-b99d-42f2-881b-8838ae9dc9ff req-b2d11fd6-70b3-4d74-ba8f-2f02141cbaac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037495 Apr 17 10:35:43 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 52/143] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:35:43 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:35:44 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-7b8a8383-9dfb-4e32-8610-1601d3937cfe req-035a86dc-3fe4-4f9c-82be-36356afa2a26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "tag": "5ead9709-8869-4070-81f0-1e397c5ba789"}, {"name": "network-changed", "server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "tag": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:35:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-7b8a8383-9dfb-4e32-8610-1601d3937cfe req-035a86dc-3fe4-4f9c-82be-36356afa2a26 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-7b8a8383-9dfb-4e32-8610-1601d3937cfe req-035a86dc-3fe4-4f9c-82be-36356afa2a26 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-7b8a8383-9dfb-4e32-8610-1601d3937cfe req-035a86dc-3fe4-4f9c-82be-36356afa2a26 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:44 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-7b8a8383-9dfb-4e32-8610-1601d3937cfe req-035a86dc-3fe4-4f9c-82be-36356afa2a26 service nova] Creating event network-changed:5ead9709-8869-4070-81f0-1e397c5ba789 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:35:44 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-7b8a8383-9dfb-4e32-8610-1601d3937cfe req-035a86dc-3fe4-4f9c-82be-36356afa2a26 service nova] Creating event network-changed:b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:35:44 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-7b8a8383-9dfb-4e32-8610-1601d3937cfe req-035a86dc-3fe4-4f9c-82be-36356afa2a26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034562 Apr 17 10:35:44 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 46/144] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:35:44 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:35:45 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:35:45 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=20 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:35:45 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-5e47a9c1-3c3e-48cd-ba76-672a588742a8 req-080e3fe2-66d2-4f62-831a-07c1af95830a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "tag": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b"}, {"name": "network-changed", "server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "tag": "c3988098-5dbd-47e1-896c-6a2b6415f64d"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:35:45 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-5e47a9c1-3c3e-48cd-ba76-672a588742a8 req-080e3fe2-66d2-4f62-831a-07c1af95830a service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:45 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-5e47a9c1-3c3e-48cd-ba76-672a588742a8 req-080e3fe2-66d2-4f62-831a-07c1af95830a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:45 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-5e47a9c1-3c3e-48cd-ba76-672a588742a8 req-080e3fe2-66d2-4f62-831a-07c1af95830a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:46 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-5e47a9c1-3c3e-48cd-ba76-672a588742a8 req-080e3fe2-66d2-4f62-831a-07c1af95830a service nova] Creating event network-changed:0ea3a20e-3d8d-4cab-9783-0a22cab2e27b for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:35:46 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-5e47a9c1-3c3e-48cd-ba76-672a588742a8 req-080e3fe2-66d2-4f62-831a-07c1af95830a service nova] Creating event network-changed:c3988098-5dbd-47e1-896c-6a2b6415f64d for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:35:46 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-5e47a9c1-3c3e-48cd-ba76-672a588742a8 req-080e3fe2-66d2-4f62-831a-07c1af95830a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.046283 Apr 17 10:35:46 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 47/145] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:35:45 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:35:46 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:35:46 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=10 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:35:46 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-56fc8211-2b3f-472d-9cd8-c8df6c962e9c req-cb539cc6-4a32-4fb5-9d1e-ba4414199eab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "tag": "74fde78e-82b3-43f3-9c87-2b754a4bd66f"}, {"name": "network-changed", "server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "tag": "b3872258-192d-4118-b77a-98dee0f21115"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:35:46 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-56fc8211-2b3f-472d-9cd8-c8df6c962e9c req-cb539cc6-4a32-4fb5-9d1e-ba4414199eab service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:46 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-56fc8211-2b3f-472d-9cd8-c8df6c962e9c req-cb539cc6-4a32-4fb5-9d1e-ba4414199eab service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:46 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-56fc8211-2b3f-472d-9cd8-c8df6c962e9c req-cb539cc6-4a32-4fb5-9d1e-ba4414199eab service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:46 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-56fc8211-2b3f-472d-9cd8-c8df6c962e9c req-cb539cc6-4a32-4fb5-9d1e-ba4414199eab service nova] Creating event network-changed:74fde78e-82b3-43f3-9c87-2b754a4bd66f for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:35:46 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-56fc8211-2b3f-472d-9cd8-c8df6c962e9c req-cb539cc6-4a32-4fb5-9d1e-ba4414199eab service nova] Creating event network-changed:b3872258-192d-4118-b77a-98dee0f21115 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:35:46 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-56fc8211-2b3f-472d-9cd8-c8df6c962e9c req-cb539cc6-4a32-4fb5-9d1e-ba4414199eab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.058141 Apr 17 10:35:46 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 53/146] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:35:46 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:35:47 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-ea5ca1e3-1e07-4ccc-81e9-eb768fac3f64 req-0c913c4d-46a9-4ee6-9c92-05feb7c24195 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "tag": "9df6de54-e8fe-425b-a344-de73c3cc5d3e"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:35:47 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-ea5ca1e3-1e07-4ccc-81e9-eb768fac3f64 req-0c913c4d-46a9-4ee6-9c92-05feb7c24195 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:47 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-ea5ca1e3-1e07-4ccc-81e9-eb768fac3f64 req-0c913c4d-46a9-4ee6-9c92-05feb7c24195 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:47 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-ea5ca1e3-1e07-4ccc-81e9-eb768fac3f64 req-0c913c4d-46a9-4ee6-9c92-05feb7c24195 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:47 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-ea5ca1e3-1e07-4ccc-81e9-eb768fac3f64 req-0c913c4d-46a9-4ee6-9c92-05feb7c24195 service nova] Creating event network-changed:9df6de54-e8fe-425b-a344-de73c3cc5d3e for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:35:47 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-ea5ca1e3-1e07-4ccc-81e9-eb768fac3f64 req-0c913c4d-46a9-4ee6-9c92-05feb7c24195 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047091 Apr 17 10:35:47 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 47/147] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:35:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:35:48 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-44e4d428-b33c-4612-ba41-4ed8c0cda396 req-a1cde865-ba72-4dda-8316-7143e0d6b846 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "tag": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:35:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-44e4d428-b33c-4612-ba41-4ed8c0cda396 req-a1cde865-ba72-4dda-8316-7143e0d6b846 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-44e4d428-b33c-4612-ba41-4ed8c0cda396 req-a1cde865-ba72-4dda-8316-7143e0d6b846 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-44e4d428-b33c-4612-ba41-4ed8c0cda396 req-a1cde865-ba72-4dda-8316-7143e0d6b846 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:48 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-44e4d428-b33c-4612-ba41-4ed8c0cda396 req-a1cde865-ba72-4dda-8316-7143e0d6b846 service nova] Creating event network-changed:2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38 for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:35:48 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-44e4d428-b33c-4612-ba41-4ed8c0cda396 req-a1cde865-ba72-4dda-8316-7143e0d6b846 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052533 Apr 17 10:35:48 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 48/148] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:35:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:35:48 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-c5fe80ad-7e8b-4691-a8a5-548890c70ea6 req-322d544a-0fcb-4ad2-8d14-5c694eb7accc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "tag": "d6c1ba60-17a7-41b4-85df-afed37da4170"}, {"name": "network-changed", "server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "tag": "552d9aee-fdf7-4e99-8521-604486e3f888"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:35:48 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-c5fe80ad-7e8b-4691-a8a5-548890c70ea6 req-322d544a-0fcb-4ad2-8d14-5c694eb7accc service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:48 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-c5fe80ad-7e8b-4691-a8a5-548890c70ea6 req-322d544a-0fcb-4ad2-8d14-5c694eb7accc service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:48 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-c5fe80ad-7e8b-4691-a8a5-548890c70ea6 req-322d544a-0fcb-4ad2-8d14-5c694eb7accc service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:48 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-c5fe80ad-7e8b-4691-a8a5-548890c70ea6 req-322d544a-0fcb-4ad2-8d14-5c694eb7accc service nova] Creating event network-changed:d6c1ba60-17a7-41b4-85df-afed37da4170 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:35:48 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-c5fe80ad-7e8b-4691-a8a5-548890c70ea6 req-322d544a-0fcb-4ad2-8d14-5c694eb7accc service nova] Creating event network-changed:552d9aee-fdf7-4e99-8521-604486e3f888 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:35:48 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-c5fe80ad-7e8b-4691-a8a5-548890c70ea6 req-322d544a-0fcb-4ad2-8d14-5c694eb7accc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034143 Apr 17 10:35:48 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 54/149] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:35:48 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:35:52 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-748f461e-22ce-4cff-8438-37bbadb17012 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:35:52 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-748f461e-22ce-4cff-8438-37bbadb17012 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:35:52 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-748f461e-22ce-4cff-8438-37bbadb17012 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:52 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-748f461e-22ce-4cff-8438-37bbadb17012 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:52 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-748f461e-22ce-4cff-8438-37bbadb17012 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:52 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-748f461e-22ce-4cff-8438-37bbadb17012 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:52 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-748f461e-22ce-4cff-8438-37bbadb17012 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:52 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-748f461e-22ce-4cff-8438-37bbadb17012 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:52 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-748f461e-22ce-4cff-8438-37bbadb17012 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c3804bb0449c8bba3b56df41ccc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ad2dd86dc14ead939b4fdca5a97a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:35:52 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-748f461e-22ce-4cff-8438-37bbadb17012 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" status: 200 len: 1523 microversion: 2.1 time: 0.466833 Apr 17 10:35:52 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 48/150] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:35:52 2023] GET /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d => generated 1523 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:35:53 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-530ce56f-441c-454d-9819-7b6b6a57c356 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:35:53 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-530ce56f-441c-454d-9819-7b6b6a57c356 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:35:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-530ce56f-441c-454d-9819-7b6b6a57c356 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-530ce56f-441c-454d-9819-7b6b6a57c356 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-530ce56f-441c-454d-9819-7b6b6a57c356 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-530ce56f-441c-454d-9819-7b6b6a57c356 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:35:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-530ce56f-441c-454d-9819-7b6b6a57c356 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:35:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-530ce56f-441c-454d-9819-7b6b6a57c356 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:35:54 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-530ce56f-441c-454d-9819-7b6b6a57c356 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a9df3167c7947aab20f7c2ef837fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50344f2e70ef48de8fbf64d408e61210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:35:54 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-530ce56f-441c-454d-9819-7b6b6a57c356 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" status: 200 len: 1549 microversion: 2.1 time: 0.563401 Apr 17 10:35:54 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 49/151] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:35:53 2023] GET /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab => generated 1549 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:36:05 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-879b18fd-fcc9-4cd5-ab34-29ddeaaca930 req-84a8fa4e-5579-4e09-81bf-0b0fb02aabb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-plugged", "status": "completed", "tag": "acaf0b67-4938-4a01-ac74-86f0935046eb"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:05 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:36:05 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=7 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:36:05 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-879b18fd-fcc9-4cd5-ab34-29ddeaaca930 req-84a8fa4e-5579-4e09-81bf-0b0fb02aabb1 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:05 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-879b18fd-fcc9-4cd5-ab34-29ddeaaca930 req-84a8fa4e-5579-4e09-81bf-0b0fb02aabb1 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:05 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-879b18fd-fcc9-4cd5-ab34-29ddeaaca930 req-84a8fa4e-5579-4e09-81bf-0b0fb02aabb1 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:05 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-879b18fd-fcc9-4cd5-ab34-29ddeaaca930 req-84a8fa4e-5579-4e09-81bf-0b0fb02aabb1 service nova] Creating event network-vif-plugged:acaf0b67-4938-4a01-ac74-86f0935046eb for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:36:05 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-879b18fd-fcc9-4cd5-ab34-29ddeaaca930 req-84a8fa4e-5579-4e09-81bf-0b0fb02aabb1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106646 Apr 17 10:36:05 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 55/152] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:36:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:05 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-1e3471ce-d0a7-4410-b19b-5c854a21a885 req-02af1ef5-9674-47b5-8624-4d2a512961c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-plugged", "status": "completed", "tag": "5ead9709-8869-4070-81f0-1e397c5ba789"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:05 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=15 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:36:05 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=27 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:36:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-1e3471ce-d0a7-4410-b19b-5c854a21a885 req-02af1ef5-9674-47b5-8624-4d2a512961c8 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-1e3471ce-d0a7-4410-b19b-5c854a21a885 req-02af1ef5-9674-47b5-8624-4d2a512961c8 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-1e3471ce-d0a7-4410-b19b-5c854a21a885 req-02af1ef5-9674-47b5-8624-4d2a512961c8 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:05 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-1e3471ce-d0a7-4410-b19b-5c854a21a885 req-02af1ef5-9674-47b5-8624-4d2a512961c8 service nova] Creating event network-vif-plugged:5ead9709-8869-4070-81f0-1e397c5ba789 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:36:05 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-1e3471ce-d0a7-4410-b19b-5c854a21a885 req-02af1ef5-9674-47b5-8624-4d2a512961c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040857 Apr 17 10:36:05 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 49/153] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:36:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:07 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-plugged", "status": "completed", "tag": "acaf0b67-4938-4a01-ac74-86f0935046eb"}, {"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-plugged", "status": "completed", "tag": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8"}, {"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-plugged", "status": "completed", "tag": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8"}, {"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-plugged", "status": "completed", "tag": "74fde78e-82b3-43f3-9c87-2b754a4bd66f"}, {"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-plugged", "status": "completed", "tag": "74fde78e-82b3-43f3-9c87-2b754a4bd66f"}, {"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-plugged", "status": "completed", "tag": "b3872258-192d-4118-b77a-98dee0f21115"}, {"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-plugged", "status": "completed", "tag": "b3872258-192d-4118-b77a-98dee0f21115"}, {"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-plugged", "status": "completed", "tag": "d6c1ba60-17a7-41b4-85df-afed37da4170"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:07 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=5 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:36:07 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=14 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:36:07 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:07 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:07 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:07 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Creating event network-vif-plugged:acaf0b67-4938-4a01-ac74-86f0935046eb for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:36:07 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Creating event network-vif-plugged:b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:36:07 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Creating event network-vif-plugged:b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:36:07 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Creating event network-vif-plugged:74fde78e-82b3-43f3-9c87-2b754a4bd66f for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:36:07 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Creating event network-vif-plugged:74fde78e-82b3-43f3-9c87-2b754a4bd66f for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:36:07 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Creating event network-vif-plugged:b3872258-192d-4118-b77a-98dee0f21115 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:36:07 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Creating event network-vif-plugged:b3872258-192d-4118-b77a-98dee0f21115 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:36:07 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] Creating event network-vif-plugged:d6c1ba60-17a7-41b4-85df-afed37da4170 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:36:07 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-8d634e1c-d15a-460c-ba7a-8244fd0e27b6 req-24334af4-616f-4307-b3af-c06a99866043 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1380 microversion: 2.1 time: 0.053593 Apr 17 10:36:07 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 50/154] 10.0.0.210 () {68 vars in 1395 bytes} [Mon Apr 17 10:36:07 2023] POST /compute/v2.1/os-server-external-events => generated 1380 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:36:07 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-e30a94e1-4339-4de0-ba96-85ceb54d027c req-e29629cb-e4d1-4f35-bdbd-3688b7dbda0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-plugged", "status": "completed", "tag": "552d9aee-fdf7-4e99-8521-604486e3f888"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-e30a94e1-4339-4de0-ba96-85ceb54d027c req-e29629cb-e4d1-4f35-bdbd-3688b7dbda0b service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-e30a94e1-4339-4de0-ba96-85ceb54d027c req-e29629cb-e4d1-4f35-bdbd-3688b7dbda0b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-e30a94e1-4339-4de0-ba96-85ceb54d027c req-e29629cb-e4d1-4f35-bdbd-3688b7dbda0b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:07 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-e30a94e1-4339-4de0-ba96-85ceb54d027c req-e29629cb-e4d1-4f35-bdbd-3688b7dbda0b service nova] Creating event network-vif-plugged:552d9aee-fdf7-4e99-8521-604486e3f888 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:36:07 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-e30a94e1-4339-4de0-ba96-85ceb54d027c req-e29629cb-e4d1-4f35-bdbd-3688b7dbda0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032413 Apr 17 10:36:07 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 56/155] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:36:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:07 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-a609757f-bca6-4a7c-9173-4ad39b48a56e req-b03c94ea-31d3-48d1-ad25-7bcb9c26bb61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-plugged", "status": "completed", "tag": "5ead9709-8869-4070-81f0-1e397c5ba789"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-a609757f-bca6-4a7c-9173-4ad39b48a56e req-b03c94ea-31d3-48d1-ad25-7bcb9c26bb61 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-a609757f-bca6-4a7c-9173-4ad39b48a56e req-b03c94ea-31d3-48d1-ad25-7bcb9c26bb61 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-a609757f-bca6-4a7c-9173-4ad39b48a56e req-b03c94ea-31d3-48d1-ad25-7bcb9c26bb61 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:07 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-a609757f-bca6-4a7c-9173-4ad39b48a56e req-b03c94ea-31d3-48d1-ad25-7bcb9c26bb61 service nova] Creating event network-vif-plugged:5ead9709-8869-4070-81f0-1e397c5ba789 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:36:07 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-a609757f-bca6-4a7c-9173-4ad39b48a56e req-b03c94ea-31d3-48d1-ad25-7bcb9c26bb61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031710 Apr 17 10:36:07 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 50/156] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:36:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:09 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-5376d921-7098-4ea2-bce8-30690899a7d4 req-e457cf7f-c026-4964-ac42-b2af7eeaa74b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-plugged", "status": "completed", "tag": "d6c1ba60-17a7-41b4-85df-afed37da4170"}, {"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-plugged", "status": "completed", "tag": "03ae70e4-ee40-4b09-a38b-a819ee74d880"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:09 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-5376d921-7098-4ea2-bce8-30690899a7d4 req-e457cf7f-c026-4964-ac42-b2af7eeaa74b service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:09 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-5376d921-7098-4ea2-bce8-30690899a7d4 req-e457cf7f-c026-4964-ac42-b2af7eeaa74b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:09 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-5376d921-7098-4ea2-bce8-30690899a7d4 req-e457cf7f-c026-4964-ac42-b2af7eeaa74b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:09 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-5376d921-7098-4ea2-bce8-30690899a7d4 req-e457cf7f-c026-4964-ac42-b2af7eeaa74b service nova] Creating event network-vif-plugged:d6c1ba60-17a7-41b4-85df-afed37da4170 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:36:09 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-5376d921-7098-4ea2-bce8-30690899a7d4 req-e457cf7f-c026-4964-ac42-b2af7eeaa74b service nova] Creating event network-vif-plugged:03ae70e4-ee40-4b09-a38b-a819ee74d880 for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:36:09 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-5376d921-7098-4ea2-bce8-30690899a7d4 req-e457cf7f-c026-4964-ac42-b2af7eeaa74b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045152 Apr 17 10:36:09 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 51/157] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:36:09 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:09 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-dce6196f-0bc1-43ae-8b86-d0b0dc71edd5 req-06e96371-9e37-40f5-80f4-6ac4ced54c2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-plugged", "status": "completed", "tag": "552d9aee-fdf7-4e99-8521-604486e3f888"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:09 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-dce6196f-0bc1-43ae-8b86-d0b0dc71edd5 req-06e96371-9e37-40f5-80f4-6ac4ced54c2e service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:09 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-dce6196f-0bc1-43ae-8b86-d0b0dc71edd5 req-06e96371-9e37-40f5-80f4-6ac4ced54c2e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:09 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-dce6196f-0bc1-43ae-8b86-d0b0dc71edd5 req-06e96371-9e37-40f5-80f4-6ac4ced54c2e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:09 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-dce6196f-0bc1-43ae-8b86-d0b0dc71edd5 req-06e96371-9e37-40f5-80f4-6ac4ced54c2e service nova] Creating event network-vif-plugged:552d9aee-fdf7-4e99-8521-604486e3f888 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:36:09 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-dce6196f-0bc1-43ae-8b86-d0b0dc71edd5 req-06e96371-9e37-40f5-80f4-6ac4ced54c2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076369 Apr 17 10:36:09 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 57/158] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:36:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:09 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-9170e02a-81ad-4643-9453-312e1a42affe req-6b308db9-efec-4350-b2cf-663293b529a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-plugged", "status": "completed", "tag": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e"}, {"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-plugged", "status": "completed", "tag": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-9170e02a-81ad-4643-9453-312e1a42affe req-6b308db9-efec-4350-b2cf-663293b529a1 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-9170e02a-81ad-4643-9453-312e1a42affe req-6b308db9-efec-4350-b2cf-663293b529a1 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-9170e02a-81ad-4643-9453-312e1a42affe req-6b308db9-efec-4350-b2cf-663293b529a1 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:09 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-9170e02a-81ad-4643-9453-312e1a42affe req-6b308db9-efec-4350-b2cf-663293b529a1 service nova] Creating event network-vif-plugged:4ea57433-f4d1-4edf-ac36-c8099ce1cd8e for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:36:09 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-9170e02a-81ad-4643-9453-312e1a42affe req-6b308db9-efec-4350-b2cf-663293b529a1 service nova] Creating event network-vif-plugged:4ea57433-f4d1-4edf-ac36-c8099ce1cd8e for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:36:09 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-9170e02a-81ad-4643-9453-312e1a42affe req-6b308db9-efec-4350-b2cf-663293b529a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033044 Apr 17 10:36:09 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 51/159] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:36:09 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:11 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-4536c991-1481-4af4-958f-34d4041792e3 req-184313b9-2420-4079-8e12-3767eb5e7f66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-plugged", "status": "completed", "tag": "03ae70e4-ee40-4b09-a38b-a819ee74d880"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:11 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-4536c991-1481-4af4-958f-34d4041792e3 req-184313b9-2420-4079-8e12-3767eb5e7f66 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:11 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-4536c991-1481-4af4-958f-34d4041792e3 req-184313b9-2420-4079-8e12-3767eb5e7f66 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:11 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-4536c991-1481-4af4-958f-34d4041792e3 req-184313b9-2420-4079-8e12-3767eb5e7f66 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:11 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-4536c991-1481-4af4-958f-34d4041792e3 req-184313b9-2420-4079-8e12-3767eb5e7f66 service nova] Creating event network-vif-plugged:03ae70e4-ee40-4b09-a38b-a819ee74d880 for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:36:11 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-4536c991-1481-4af4-958f-34d4041792e3 req-184313b9-2420-4079-8e12-3767eb5e7f66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038727 Apr 17 10:36:11 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 52/160] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:36:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:11 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-6abf7e21-9a91-4835-aef6-5f7db6dc6909 req-25430bc2-979a-441d-b833-937e6bc0b404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-plugged", "status": "completed", "tag": "c3988098-5dbd-47e1-896c-6a2b6415f64d"}, {"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-plugged", "status": "completed", "tag": "c3988098-5dbd-47e1-896c-6a2b6415f64d"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:11 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-6abf7e21-9a91-4835-aef6-5f7db6dc6909 req-25430bc2-979a-441d-b833-937e6bc0b404 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:11 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-6abf7e21-9a91-4835-aef6-5f7db6dc6909 req-25430bc2-979a-441d-b833-937e6bc0b404 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:11 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-6abf7e21-9a91-4835-aef6-5f7db6dc6909 req-25430bc2-979a-441d-b833-937e6bc0b404 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:11 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-6abf7e21-9a91-4835-aef6-5f7db6dc6909 req-25430bc2-979a-441d-b833-937e6bc0b404 service nova] Creating event network-vif-plugged:c3988098-5dbd-47e1-896c-6a2b6415f64d for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:36:11 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-6abf7e21-9a91-4835-aef6-5f7db6dc6909 req-25430bc2-979a-441d-b833-937e6bc0b404 service nova] Creating event network-vif-plugged:c3988098-5dbd-47e1-896c-6a2b6415f64d for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:36:11 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-6abf7e21-9a91-4835-aef6-5f7db6dc6909 req-25430bc2-979a-441d-b833-937e6bc0b404 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032080 Apr 17 10:36:11 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 58/161] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:36:11 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:11 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-plugged", "status": "completed", "tag": "77da47f6-f251-457d-b4c9-a2687922abc5"}, {"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-plugged", "status": "completed", "tag": "77da47f6-f251-457d-b4c9-a2687922abc5"}, {"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-plugged", "status": "completed", "tag": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b"}, {"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-plugged", "status": "completed", "tag": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b"}, {"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-plugged", "status": "completed", "tag": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38"}, {"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-plugged", "status": "completed", "tag": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38"}, {"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-plugged", "status": "completed", "tag": "9df6de54-e8fe-425b-a344-de73c3cc5d3e"}, {"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-plugged", "status": "completed", "tag": "9df6de54-e8fe-425b-a344-de73c3cc5d3e"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Creating event network-vif-plugged:77da47f6-f251-457d-b4c9-a2687922abc5 for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:36:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Creating event network-vif-plugged:77da47f6-f251-457d-b4c9-a2687922abc5 for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:36:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Creating event network-vif-plugged:0ea3a20e-3d8d-4cab-9783-0a22cab2e27b for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:36:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Creating event network-vif-plugged:0ea3a20e-3d8d-4cab-9783-0a22cab2e27b for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:36:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Creating event network-vif-plugged:2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38 for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:36:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Creating event network-vif-plugged:2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38 for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:36:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Creating event network-vif-plugged:9df6de54-e8fe-425b-a344-de73c3cc5d3e for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:36:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] Creating event network-vif-plugged:9df6de54-e8fe-425b-a344-de73c3cc5d3e for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:36:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-4df7e7cc-ebc9-4ee7-a748-1381270a601e req-612f2b7d-a2ac-47fd-9b10-d5686ba3d0a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1380 microversion: 2.1 time: 0.037886 Apr 17 10:36:11 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 52/162] 10.0.0.210 () {68 vars in 1395 bytes} [Mon Apr 17 10:36:11 2023] POST /compute/v2.1/os-server-external-events => generated 1380 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:36:14 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-f657970b-64d8-403c-811f-c9d094be4cc8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:36:14 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-f657970b-64d8-403c-811f-c9d094be4cc8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:36:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f657970b-64d8-403c-811f-c9d094be4cc8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f657970b-64d8-403c-811f-c9d094be4cc8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f657970b-64d8-403c-811f-c9d094be4cc8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f657970b-64d8-403c-811f-c9d094be4cc8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f657970b-64d8-403c-811f-c9d094be4cc8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f657970b-64d8-403c-811f-c9d094be4cc8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:14 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-f657970b-64d8-403c-811f-c9d094be4cc8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea177954e75a45f7ad7c9831ab55375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0c657dc95549a3a3ce94f35bfa91be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:36:14 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-f657970b-64d8-403c-811f-c9d094be4cc8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735" status: 200 len: 1564 microversion: 2.1 time: 0.757936 Apr 17 10:36:14 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 53/163] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:36:14 2023] GET /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735 => generated 1564 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:36:17 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-8deca43c-3344-40ad-8ccd-7265bd929748 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Action: 'create', calling method: .version_select at 0x7fc55ad3fa30>, body: {"keypair": {"name": "tempest-TestShelveInstance-993329906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDH4FFXKqH+g7k0ASGnNDXfUy/R1u6icWp+zf9vlgtMbomh5J54TN/pK57/PFpeGZBHXgpMBfbuezVh6SWpKdljIUuRGib6lK5tHsF/MEgxDHkpa84AcMmldHwjGud+ZtQ=="}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:17 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-8deca43c-3344-40ad-8ccd-7265bd929748 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Getting quotas for project 5a793afb3e7045898c59a77975079d72. Resources: {'key_pairs'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:36:17 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-8deca43c-3344-40ad-8ccd-7265bd929748 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Getting quotas for user b43c0aee7b05459d898e0dc2654262fa and project 5a793afb3e7045898c59a77975079d72. Resources: {'key_pairs'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:36:17 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-8deca43c-3344-40ad-8ccd-7265bd929748 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.322967 Apr 17 10:36:17 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 59/164] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 10:36:16 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:19 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-31642419"}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:19 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:36:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:20 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-a9e0b62f-b7e5-452e-b875-9e18b7aeaa2a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "POST /compute/v2.1/servers/60008675-7786-4a26-9640-49da6efd0adb/action" status: 202 len: 52 microversion: 2.87 time: 0.946008 Apr 17 10:36:20 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 53/165] 10.0.0.210 () {66 vars in 1396 bytes} [Mon Apr 17 10:36:19 2023] POST /compute/v2.1/servers/60008675-7786-4a26-9640-49da6efd0adb/action => generated 52 bytes in 948 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 17 10:36:23 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-906009009", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-993329906", "security_groups": [{"name": "tempest-secgroup-smoke-133939051"}], "networks": [{"uuid": "68557115-4630-4346-b494-d569a7bf3e75"}], "block_device_mapping_v2": [{"uuid": "32955c44-ba4e-4422-bebe-32b68bb7b970", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:23 user devstack@n-api.service[72743]: DEBUG nova.network.neutron [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] validate_networks() for [('68557115-4630-4346-b494-d569a7bf3e75', None, None, None, None, None)] {{(pid=72743) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:36:23 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Flavor limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:36:23 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Image limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:36:23 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Flavor pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:36:23 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Image pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:36:23 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:36:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:23 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Getting quotas for project 5a793afb3e7045898c59a77975079d72. Resources: {'cores', 'instances', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:36:23 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Getting quotas for user b43c0aee7b05459d898e0dc2654262fa and project 5a793afb3e7045898c59a77975079d72. Resources: {'cores', 'instances', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:36:24 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Going to run 1 instances... {{(pid=72743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:36:24 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='32955c44-ba4e-4422-bebe-32b68bb7b970',volume_size=None,volume_type=None)] {{(pid=72743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:36:24 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-bfb0814c-b4ee-43dc-b9cf-28c60c9d0055 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.821812 Apr 17 10:36:24 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 54/166] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:36:23 2023] POST /compute/v2.1/servers => generated 403 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 10:36:24 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=8 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:36:24 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-4c57ddc0-021a-4399-9d3c-8a518f3f33dd tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:36:24 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-4c57ddc0-021a-4399-9d3c-8a518f3f33dd tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:36:24 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-4c57ddc0-021a-4399-9d3c-8a518f3f33dd tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43c0aee7b05459d898e0dc2654262fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a793afb3e7045898c59a77975079d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:36:24 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-4c57ddc0-021a-4399-9d3c-8a518f3f33dd tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0c707ac-b08f-4f18-8262-e1b79d7e17e1" status: 200 len: 1082 microversion: 2.1 time: 0.086121 Apr 17 10:36:24 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 60/167] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:36:24 2023] GET /compute/v2.1/servers/b0c707ac-b08f-4f18-8262-e1b79d7e17e1 => generated 1082 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:36:25 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-99c63d10-233e-4f92-88e1-e71a570a31bf tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:36:25 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-99c63d10-233e-4f92-88e1-e71a570a31bf tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:36:25 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-99c63d10-233e-4f92-88e1-e71a570a31bf tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:25 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-99c63d10-233e-4f92-88e1-e71a570a31bf tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:25 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-99c63d10-233e-4f92-88e1-e71a570a31bf tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:25 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-99c63d10-233e-4f92-88e1-e71a570a31bf tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:25 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-99c63d10-233e-4f92-88e1-e71a570a31bf tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:25 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-99c63d10-233e-4f92-88e1-e71a570a31bf tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:25 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "507c10d6-f250-402f-b7e4-2bf36b541aa4"}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:25 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:36:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:26 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-006a39cf-ba0d-42b5-8d4d-8d7e504c0772 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:36:26 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-006a39cf-ba0d-42b5-8d4d-8d7e504c0772 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:36:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-006a39cf-ba0d-42b5-8d4d-8d7e504c0772 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-006a39cf-ba0d-42b5-8d4d-8d7e504c0772 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-006a39cf-ba0d-42b5-8d4d-8d7e504c0772 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-006a39cf-ba0d-42b5-8d4d-8d7e504c0772 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-006a39cf-ba0d-42b5-8d4d-8d7e504c0772 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-006a39cf-ba0d-42b5-8d4d-8d7e504c0772 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:26 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-cad516f6-47f7-475c-9b1c-cef6f87faa2e tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6cc638ee-d494-4523-8d12-9ede0853ecd6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.523484 Apr 17 10:36:26 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 55/168] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Apr 17 10:36:25 2023] POST /compute/v2.1/servers/6cc638ee-d494-4523-8d12-9ede0853ecd6/os-volume_attachments => generated 194 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:26 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-006a39cf-ba0d-42b5-8d4d-8d7e504c0772 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:36:26 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-006a39cf-ba0d-42b5-8d4d-8d7e504c0772 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:36:26 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-006a39cf-ba0d-42b5-8d4d-8d7e504c0772 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:36:26 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-99c63d10-233e-4f92-88e1-e71a570a31bf tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa1a7dc224ec4bd8ebd5fdef1fbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d324884a4e5785c896d76b2a9376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:36:26 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-006a39cf-ba0d-42b5-8d4d-8d7e504c0772 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/60008675-7786-4a26-9640-49da6efd0adb" status: 200 len: 1703 microversion: 2.87 time: 0.343345 Apr 17 10:36:26 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 61/169] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:36:26 2023] GET /compute/v2.1/servers/60008675-7786-4a26-9640-49da6efd0adb => generated 1703 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:36:26 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-99c63d10-233e-4f92-88e1-e71a570a31bf tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41eaa1a7dc224ec4bd8ebd5fdef1fbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d324884a4e5785c896d76b2a9376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:36:26 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-99c63d10-233e-4f92-88e1-e71a570a31bf tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41eaa1a7dc224ec4bd8ebd5fdef1fbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d324884a4e5785c896d76b2a9376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:36:26 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-99c63d10-233e-4f92-88e1-e71a570a31bf tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] 10.0.0.210 "GET /compute/v2.1/servers/250f2cd2-b6ba-4a89-921f-cbd21ac36525" status: 200 len: 2819 microversion: 2.32 time: 0.905889 Apr 17 10:36:26 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 54/170] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:36:25 2023] GET /compute/v2.1/servers/250f2cd2-b6ba-4a89-921f-cbd21ac36525 => generated 2819 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:36:26 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-3426d0d4-3fed-4fc5-a47f-c945c01aec1b tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:36:26 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-3426d0d4-3fed-4fc5-a47f-c945c01aec1b tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:36:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3426d0d4-3fed-4fc5-a47f-c945c01aec1b tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3426d0d4-3fed-4fc5-a47f-c945c01aec1b tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3426d0d4-3fed-4fc5-a47f-c945c01aec1b tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3426d0d4-3fed-4fc5-a47f-c945c01aec1b tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3426d0d4-3fed-4fc5-a47f-c945c01aec1b tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3426d0d4-3fed-4fc5-a47f-c945c01aec1b tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:27 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-3426d0d4-3fed-4fc5-a47f-c945c01aec1b tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245581ebc4824aa7addd4d4272d4a47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c3233510fa4ef1bb876bd6ee37a443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:36:27 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-3426d0d4-3fed-4fc5-a47f-c945c01aec1b tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245581ebc4824aa7addd4d4272d4a47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c3233510fa4ef1bb876bd6ee37a443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:36:27 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-3426d0d4-3fed-4fc5-a47f-c945c01aec1b tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245581ebc4824aa7addd4d4272d4a47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c3233510fa4ef1bb876bd6ee37a443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:36:27 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-3426d0d4-3fed-4fc5-a47f-c945c01aec1b tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f120f04-ecbf-496e-81c9-dcfed9084064" status: 200 len: 2822 microversion: 2.42 time: 0.794466 Apr 17 10:36:27 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 56/171] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:36:26 2023] GET /compute/v2.1/servers/1f120f04-ecbf-496e-81c9-dcfed9084064 => generated 2822 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:36:28 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-be3fc065-62e9-4ec4-b81b-13a3c88c65f3 req-d1f62f9c-d736-4455-abfb-f63fde35a112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c707ac-b08f-4f18-8262-e1b79d7e17e1", "tag": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-be3fc065-62e9-4ec4-b81b-13a3c88c65f3 req-d1f62f9c-d736-4455-abfb-f63fde35a112 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-be3fc065-62e9-4ec4-b81b-13a3c88c65f3 req-d1f62f9c-d736-4455-abfb-f63fde35a112 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-be3fc065-62e9-4ec4-b81b-13a3c88c65f3 req-d1f62f9c-d736-4455-abfb-f63fde35a112 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:28 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-be3fc065-62e9-4ec4-b81b-13a3c88c65f3 req-d1f62f9c-d736-4455-abfb-f63fde35a112 service nova] Creating event network-changed:90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 for instance b0c707ac-b08f-4f18-8262-e1b79d7e17e1 on user Apr 17 10:36:28 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-be3fc065-62e9-4ec4-b81b-13a3c88c65f3 req-d1f62f9c-d736-4455-abfb-f63fde35a112 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034702 Apr 17 10:36:28 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 62/172] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:36:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:28 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-44ccc0a6-a73d-4941-a498-c21773e9e321 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:36:28 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-44ccc0a6-a73d-4941-a498-c21773e9e321 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:36:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-44ccc0a6-a73d-4941-a498-c21773e9e321 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-44ccc0a6-a73d-4941-a498-c21773e9e321 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-44ccc0a6-a73d-4941-a498-c21773e9e321 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-44ccc0a6-a73d-4941-a498-c21773e9e321 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-44ccc0a6-a73d-4941-a498-c21773e9e321 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-44ccc0a6-a73d-4941-a498-c21773e9e321 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:28 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-44ccc0a6-a73d-4941-a498-c21773e9e321 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.251477 Apr 17 10:36:28 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 55/173] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 17 10:36:28 2023] GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99/os-interface => generated 282 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:30 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-f976c39f-de3a-49d2-8cab-a30c082232c7 req-53975a02-dedd-4e9e-bf5f-5a523c1725d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59fd26de-d46e-4f41-91f6-090005a07d99", "tag": "7124043d-665c-4a42-a041-b91ccc237b63"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:30 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-f976c39f-de3a-49d2-8cab-a30c082232c7 req-53975a02-dedd-4e9e-bf5f-5a523c1725d3 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:30 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-f976c39f-de3a-49d2-8cab-a30c082232c7 req-53975a02-dedd-4e9e-bf5f-5a523c1725d3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:30 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-f976c39f-de3a-49d2-8cab-a30c082232c7 req-53975a02-dedd-4e9e-bf5f-5a523c1725d3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:30 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-f976c39f-de3a-49d2-8cab-a30c082232c7 req-53975a02-dedd-4e9e-bf5f-5a523c1725d3 service nova] Creating event network-changed:7124043d-665c-4a42-a041-b91ccc237b63 for instance 59fd26de-d46e-4f41-91f6-090005a07d99 on user Apr 17 10:36:30 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-f976c39f-de3a-49d2-8cab-a30c082232c7 req-53975a02-dedd-4e9e-bf5f-5a523c1725d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034293 Apr 17 10:36:30 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 57/174] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:36:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:30 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-3edb51c7-36d8-46b9-8b88-148fb20f5f62 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:36:30 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-3edb51c7-36d8-46b9-8b88-148fb20f5f62 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:36:30 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3edb51c7-36d8-46b9-8b88-148fb20f5f62 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:30 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3edb51c7-36d8-46b9-8b88-148fb20f5f62 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:30 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3edb51c7-36d8-46b9-8b88-148fb20f5f62 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:30 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3edb51c7-36d8-46b9-8b88-148fb20f5f62 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:30 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3edb51c7-36d8-46b9-8b88-148fb20f5f62 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:30 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3edb51c7-36d8-46b9-8b88-148fb20f5f62 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:30 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-3edb51c7-36d8-46b9-8b88-148fb20f5f62 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99/ips" status: 200 len: 103 microversion: 2.1 time: 0.253361 Apr 17 10:36:30 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 63/175] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 17 10:36:30 2023] GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99/ips => generated 103 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:31 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-310ffbfe-5f94-43ec-bdfc-ab8e46fcf044 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:36:31 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-310ffbfe-5f94-43ec-bdfc-ab8e46fcf044 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:36:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-310ffbfe-5f94-43ec-bdfc-ab8e46fcf044 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-310ffbfe-5f94-43ec-bdfc-ab8e46fcf044 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-310ffbfe-5f94-43ec-bdfc-ab8e46fcf044 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-310ffbfe-5f94-43ec-bdfc-ab8e46fcf044 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-310ffbfe-5f94-43ec-bdfc-ab8e46fcf044 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-310ffbfe-5f94-43ec-bdfc-ab8e46fcf044 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:31 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-310ffbfe-5f94-43ec-bdfc-ab8e46fcf044 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.164287 Apr 17 10:36:31 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 56/176] 10.0.0.210 () {64 vars in 1393 bytes} [Mon Apr 17 10:36:31 2023] GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d/os-interface => generated 282 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 10:36:32 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-028d74ee-7644-4381-9fd1-915c4256c657 req-b982b4b1-9c55-40bc-a55c-21822e81fd3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4315753-415c-45cd-b06f-da1e3ccc6e4d", "tag": "cd279a0c-99eb-4e32-876e-6d2208cc1db2"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-028d74ee-7644-4381-9fd1-915c4256c657 req-b982b4b1-9c55-40bc-a55c-21822e81fd3c service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-028d74ee-7644-4381-9fd1-915c4256c657 req-b982b4b1-9c55-40bc-a55c-21822e81fd3c service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-028d74ee-7644-4381-9fd1-915c4256c657 req-b982b4b1-9c55-40bc-a55c-21822e81fd3c service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:32 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-028d74ee-7644-4381-9fd1-915c4256c657 req-b982b4b1-9c55-40bc-a55c-21822e81fd3c service nova] Creating event network-changed:cd279a0c-99eb-4e32-876e-6d2208cc1db2 for instance c4315753-415c-45cd-b06f-da1e3ccc6e4d on user Apr 17 10:36:32 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-028d74ee-7644-4381-9fd1-915c4256c657 req-b982b4b1-9c55-40bc-a55c-21822e81fd3c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033205 Apr 17 10:36:32 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 58/177] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:36:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:32 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-91c517f3-2a5f-4da2-8ceb-b39f790a0860 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:36:32 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-91c517f3-2a5f-4da2-8ceb-b39f790a0860 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:36:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-91c517f3-2a5f-4da2-8ceb-b39f790a0860 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-91c517f3-2a5f-4da2-8ceb-b39f790a0860 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-91c517f3-2a5f-4da2-8ceb-b39f790a0860 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-91c517f3-2a5f-4da2-8ceb-b39f790a0860 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-91c517f3-2a5f-4da2-8ceb-b39f790a0860 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-91c517f3-2a5f-4da2-8ceb-b39f790a0860 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:32 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-91c517f3-2a5f-4da2-8ceb-b39f790a0860 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d/ips" status: 200 len: 109 microversion: 2.20 time: 0.034194 Apr 17 10:36:32 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 64/178] 10.0.0.210 () {64 vars in 1366 bytes} [Mon Apr 17 10:36:32 2023] GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d/ips => generated 109 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 10:36:32 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77166f39-c9b1-499f-9ed8-1fdd6a0d81a1"}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:32 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:36:32 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:32 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:32 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:32 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:32 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:32 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:33 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-bbf9f723-2112-4f0b-bbb0-7764b8fcbebd tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "POST /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311505 Apr 17 10:36:33 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 57/179] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Apr 17 10:36:32 2023] POST /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:34 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:36:34 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:36:34 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:34 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:36:34 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:34 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:34 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:34 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:34 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:34 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:34 user devstack@n-api.service[72743]: DEBUG nova.objects.instance [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lazy-loading 'flavor' on Instance uuid c4315753-415c-45cd-b06f-da1e3ccc6e4d {{(pid=72743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 10:36:35 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:36:35 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-dcaf8a26-43e7-46ca-99ca-9c66e8da576d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:36:35 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-dcaf8a26-43e7-46ca-99ca-9c66e8da576d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:36:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-dcaf8a26-43e7-46ca-99ca-9c66e8da576d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-dcaf8a26-43e7-46ca-99ca-9c66e8da576d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-dcaf8a26-43e7-46ca-99ca-9c66e8da576d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-dcaf8a26-43e7-46ca-99ca-9c66e8da576d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-dcaf8a26-43e7-46ca-99ca-9c66e8da576d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-dcaf8a26-43e7-46ca-99ca-9c66e8da576d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:35 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-912aba00-d808-4d1f-afbb-cd9ea2d84aa6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d/action" status: 202 len: 0 microversion: 2.20 time: 0.832167 Apr 17 10:36:35 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 59/180] 10.0.0.210 () {66 vars in 1396 bytes} [Mon Apr 17 10:36:34 2023] POST /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d/action => generated 0 bytes in 834 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:36:35 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-eca8ac24-71e1-41cd-8670-e4afdc76226a tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:36:35 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-eca8ac24-71e1-41cd-8670-e4afdc76226a tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:36:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-eca8ac24-71e1-41cd-8670-e4afdc76226a tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-eca8ac24-71e1-41cd-8670-e4afdc76226a tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-eca8ac24-71e1-41cd-8670-e4afdc76226a tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-eca8ac24-71e1-41cd-8670-e4afdc76226a tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-eca8ac24-71e1-41cd-8670-e4afdc76226a tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-eca8ac24-71e1-41cd-8670-e4afdc76226a tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:35 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-dcaf8a26-43e7-46ca-99ca-9c66e8da576d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.184530 Apr 17 10:36:35 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 65/181] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 17 10:36:35 2023] GET /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/os-interface => generated 282 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:35 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-eca8ac24-71e1-41cd-8670-e4afdc76226a tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:36:35 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:36:35 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-eca8ac24-71e1-41cd-8670-e4afdc76226a tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:36:35 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-eca8ac24-71e1-41cd-8670-e4afdc76226a tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:36:35 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-eca8ac24-71e1-41cd-8670-e4afdc76226a tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d" status: 200 len: 1706 microversion: 2.20 time: 0.176782 Apr 17 10:36:35 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 58/182] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:36:35 2023] GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d => generated 1706 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:36:36 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-0e93fe5a-bb09-4852-8208-17fcfb703b3b req-a80e9085-5a90-4df5-a9df-5d59ef8e83c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4315753-415c-45cd-b06f-da1e3ccc6e4d", "name": "network-vif-unplugged", "status": "completed", "tag": "cd279a0c-99eb-4e32-876e-6d2208cc1db2"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:36 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-0e93fe5a-bb09-4852-8208-17fcfb703b3b req-a80e9085-5a90-4df5-a9df-5d59ef8e83c1 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:36 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-0e93fe5a-bb09-4852-8208-17fcfb703b3b req-a80e9085-5a90-4df5-a9df-5d59ef8e83c1 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:36 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-0e93fe5a-bb09-4852-8208-17fcfb703b3b req-a80e9085-5a90-4df5-a9df-5d59ef8e83c1 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:36 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-0e93fe5a-bb09-4852-8208-17fcfb703b3b req-a80e9085-5a90-4df5-a9df-5d59ef8e83c1 service nova] Creating event network-vif-unplugged:cd279a0c-99eb-4e32-876e-6d2208cc1db2 for instance c4315753-415c-45cd-b06f-da1e3ccc6e4d on user Apr 17 10:36:36 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-0e93fe5a-bb09-4852-8208-17fcfb703b3b req-a80e9085-5a90-4df5-a9df-5d59ef8e83c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030279 Apr 17 10:36:36 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 60/183] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:36:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:36 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-eeffd1f4-f694-433d-b4b9-05de59eb0650 req-3fb81b9e-9d7a-46e2-9bbe-f349f380aaef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4", "tag": "f839dea5-4294-4842-bfa2-262351dabfb9"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:36 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-eeffd1f4-f694-433d-b4b9-05de59eb0650 req-3fb81b9e-9d7a-46e2-9bbe-f349f380aaef service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:36 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-eeffd1f4-f694-433d-b4b9-05de59eb0650 req-3fb81b9e-9d7a-46e2-9bbe-f349f380aaef service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:36 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-eeffd1f4-f694-433d-b4b9-05de59eb0650 req-3fb81b9e-9d7a-46e2-9bbe-f349f380aaef service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:36 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-eeffd1f4-f694-433d-b4b9-05de59eb0650 req-3fb81b9e-9d7a-46e2-9bbe-f349f380aaef service nova] Creating event network-changed:f839dea5-4294-4842-bfa2-262351dabfb9 for instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 on user Apr 17 10:36:36 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-eeffd1f4-f694-433d-b4b9-05de59eb0650 req-3fb81b9e-9d7a-46e2-9bbe-f349f380aaef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032745 Apr 17 10:36:36 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 66/184] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:36:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:36 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-149555220"}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:36 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:36:36 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=21 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:36:36 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:36 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:36 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:36 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:36 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:36 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:37 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-1614a9fa-e0ed-4a60-8d3d-34ffe7278110 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/action" status: 202 len: 0 microversion: 2.1 time: 0.984871 Apr 17 10:36:37 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 59/185] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 10:36:36 2023] POST /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/action => generated 0 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 17 10:36:37 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-bc0cbb4f-b970-40b6-bb92-adf34dfc3d40 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Calling method '.version_select at 0x7fc55ac88e50>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:36:37 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-bc0cbb4f-b970-40b6-bb92-adf34dfc3d40 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] 10.0.0.210 "GET /compute/v2.1/images/1d484d43-a1db-4806-ae9e-7be2347dbfec" status: 200 len: 1610 microversion: 2.1 time: 0.056930 Apr 17 10:36:37 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 61/186] 10.0.0.210 () {62 vars in 1310 bytes} [Mon Apr 17 10:36:37 2023] GET /compute/v2.1/images/1d484d43-a1db-4806-ae9e-7be2347dbfec => generated 1610 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:36:38 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-cd14d49b-1ad1-419a-ad1c-3098bdfc94e0 req-280af5c4-5577-4975-af25-78934d8e57b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4315753-415c-45cd-b06f-da1e3ccc6e4d", "name": "network-vif-plugged", "status": "completed", "tag": "cd279a0c-99eb-4e32-876e-6d2208cc1db2"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:38 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-cd14d49b-1ad1-419a-ad1c-3098bdfc94e0 req-280af5c4-5577-4975-af25-78934d8e57b0 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:38 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-cd14d49b-1ad1-419a-ad1c-3098bdfc94e0 req-280af5c4-5577-4975-af25-78934d8e57b0 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:38 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-cd14d49b-1ad1-419a-ad1c-3098bdfc94e0 req-280af5c4-5577-4975-af25-78934d8e57b0 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:38 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-cd14d49b-1ad1-419a-ad1c-3098bdfc94e0 req-280af5c4-5577-4975-af25-78934d8e57b0 service nova] Creating event network-vif-plugged:cd279a0c-99eb-4e32-876e-6d2208cc1db2 for instance c4315753-415c-45cd-b06f-da1e3ccc6e4d on user Apr 17 10:36:38 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-cd14d49b-1ad1-419a-ad1c-3098bdfc94e0 req-280af5c4-5577-4975-af25-78934d8e57b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033778 Apr 17 10:36:38 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 67/187] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:36:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:38 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:36:38 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:36:38 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:38 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:38 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:38 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:38 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:38 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:38 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Going to try to terminate instance {{(pid=72744) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:36:38 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-06519931-2a24-443f-85a9-046731afa1f5 req-fae49d57-1f35-4f13-85d5-6af1e6980c44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c707ac-b08f-4f18-8262-e1b79d7e17e1", "name": "network-vif-plugged", "status": "completed", "tag": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3"}, {"server_uuid": "b0c707ac-b08f-4f18-8262-e1b79d7e17e1", "name": "network-vif-plugged", "status": "completed", "tag": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:38 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:36:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-06519931-2a24-443f-85a9-046731afa1f5 req-fae49d57-1f35-4f13-85d5-6af1e6980c44 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-06519931-2a24-443f-85a9-046731afa1f5 req-fae49d57-1f35-4f13-85d5-6af1e6980c44 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-06519931-2a24-443f-85a9-046731afa1f5 req-fae49d57-1f35-4f13-85d5-6af1e6980c44 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:38 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:36:38 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-06519931-2a24-443f-85a9-046731afa1f5 req-fae49d57-1f35-4f13-85d5-6af1e6980c44 service nova] Creating event network-vif-plugged:90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 for instance b0c707ac-b08f-4f18-8262-e1b79d7e17e1 on user Apr 17 10:36:38 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-06519931-2a24-443f-85a9-046731afa1f5 req-fae49d57-1f35-4f13-85d5-6af1e6980c44 service nova] Creating event network-vif-plugged:90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 for instance b0c707ac-b08f-4f18-8262-e1b79d7e17e1 on user Apr 17 10:36:38 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-06519931-2a24-443f-85a9-046731afa1f5 req-fae49d57-1f35-4f13-85d5-6af1e6980c44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048253 Apr 17 10:36:38 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 62/188] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:36:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:38 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-547689a3-bb24-4637-9337-e1e6861d408c tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6cc638ee-d494-4523-8d12-9ede0853ecd6" status: 204 len: 0 microversion: 2.1 time: 0.281440 Apr 17 10:36:38 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 60/189] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:36:38 2023] DELETE /compute/v2.1/servers/6cc638ee-d494-4523-8d12-9ede0853ecd6 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:36:38 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-6550b8b9-2064-4c11-845d-b1df20bfa1aa tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:36:38 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-6550b8b9-2064-4c11-845d-b1df20bfa1aa tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:36:38 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6550b8b9-2064-4c11-845d-b1df20bfa1aa tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:38 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6550b8b9-2064-4c11-845d-b1df20bfa1aa tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:38 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6550b8b9-2064-4c11-845d-b1df20bfa1aa tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:38 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6550b8b9-2064-4c11-845d-b1df20bfa1aa tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:38 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6550b8b9-2064-4c11-845d-b1df20bfa1aa tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:38 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6550b8b9-2064-4c11-845d-b1df20bfa1aa tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:39 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-6550b8b9-2064-4c11-845d-b1df20bfa1aa tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4863ef9d61412a997abf4f27cce1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02daa1fd267646fbb4f726b247ba4a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:36:39 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-6550b8b9-2064-4c11-845d-b1df20bfa1aa tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cc638ee-d494-4523-8d12-9ede0853ecd6" status: 200 len: 1542 microversion: 2.1 time: 0.339322 Apr 17 10:36:39 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 68/190] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:36:38 2023] GET /compute/v2.1/servers/6cc638ee-d494-4523-8d12-9ede0853ecd6 => generated 1542 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:36:40 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-79fbcbb1-e9db-42ab-a8fb-5d1a80428ccb req-2b66ea2c-98ca-46bf-94ce-8dafb63299d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cc638ee-d494-4523-8d12-9ede0853ecd6", "name": "network-vif-unplugged", "status": "completed", "tag": "d6ac6671-38e6-49a1-ba35-e903ffc15afa"}, {"server_uuid": "6cc638ee-d494-4523-8d12-9ede0853ecd6", "name": "network-vif-plugged", "status": "completed", "tag": "d6ac6671-38e6-49a1-ba35-e903ffc15afa"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-79fbcbb1-e9db-42ab-a8fb-5d1a80428ccb req-2b66ea2c-98ca-46bf-94ce-8dafb63299d6 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-79fbcbb1-e9db-42ab-a8fb-5d1a80428ccb req-2b66ea2c-98ca-46bf-94ce-8dafb63299d6 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-79fbcbb1-e9db-42ab-a8fb-5d1a80428ccb req-2b66ea2c-98ca-46bf-94ce-8dafb63299d6 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:40 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-79fbcbb1-e9db-42ab-a8fb-5d1a80428ccb req-2b66ea2c-98ca-46bf-94ce-8dafb63299d6 service nova] Creating event network-vif-unplugged:d6ac6671-38e6-49a1-ba35-e903ffc15afa for instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 on user Apr 17 10:36:40 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-79fbcbb1-e9db-42ab-a8fb-5d1a80428ccb req-2b66ea2c-98ca-46bf-94ce-8dafb63299d6 service nova] Creating event network-vif-plugged:d6ac6671-38e6-49a1-ba35-e903ffc15afa for instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 on user Apr 17 10:36:40 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-79fbcbb1-e9db-42ab-a8fb-5d1a80428ccb req-2b66ea2c-98ca-46bf-94ce-8dafb63299d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.029984 Apr 17 10:36:40 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 63/191] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:36:40 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:40 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-a6d854f6-cc2a-41c8-904f-cda539980e77 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a6d854f6-cc2a-41c8-904f-cda539980e77 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a6d854f6-cc2a-41c8-904f-cda539980e77 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a6d854f6-cc2a-41c8-904f-cda539980e77 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:40 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-a6d854f6-cc2a-41c8-904f-cda539980e77 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Going to try to stop instance {{(pid=72744) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 17 10:36:40 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-a6d854f6-cc2a-41c8-904f-cda539980e77 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "POST /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99/action" status: 202 len: 0 microversion: 2.1 time: 0.139954 Apr 17 10:36:40 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 61/192] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 10:36:40 2023] POST /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:36:40 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-d46e92e3-e704-4635-bc48-c238bd00cbf4 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:36:40 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-d46e92e3-e704-4635-bc48-c238bd00cbf4 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:36:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d46e92e3-e704-4635-bc48-c238bd00cbf4 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d46e92e3-e704-4635-bc48-c238bd00cbf4 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d46e92e3-e704-4635-bc48-c238bd00cbf4 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d46e92e3-e704-4635-bc48-c238bd00cbf4 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d46e92e3-e704-4635-bc48-c238bd00cbf4 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d46e92e3-e704-4635-bc48-c238bd00cbf4 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:41 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-d46e92e3-e704-4635-bc48-c238bd00cbf4 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9862432f87f4500a46f32a0b27d54d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a17ec3e1b314acbb701f2d2d27d0560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:36:41 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-d46e92e3-e704-4635-bc48-c238bd00cbf4 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99" status: 200 len: 1708 microversion: 2.1 time: 0.308087 Apr 17 10:36:41 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 69/193] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:36:40 2023] GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99 => generated 1708 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 17 10:36:42 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-f180a9ab-6aa6-469d-812c-f592ba7746cf req-675cb31d-3c85-4099-8020-514c4ca29c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cc638ee-d494-4523-8d12-9ede0853ecd6", "name": "network-vif-deleted", "tag": "d6ac6671-38e6-49a1-ba35-e903ffc15afa"}, {"server_uuid": "59fd26de-d46e-4f41-91f6-090005a07d99", "name": "network-vif-unplugged", "status": "completed", "tag": "7124043d-665c-4a42-a041-b91ccc237b63"}, {"server_uuid": "59fd26de-d46e-4f41-91f6-090005a07d99", "name": "network-vif-plugged", "status": "completed", "tag": "7124043d-665c-4a42-a041-b91ccc237b63"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-f180a9ab-6aa6-469d-812c-f592ba7746cf req-675cb31d-3c85-4099-8020-514c4ca29c66 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-f180a9ab-6aa6-469d-812c-f592ba7746cf req-675cb31d-3c85-4099-8020-514c4ca29c66 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-f180a9ab-6aa6-469d-812c-f592ba7746cf req-675cb31d-3c85-4099-8020-514c4ca29c66 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:42 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-f180a9ab-6aa6-469d-812c-f592ba7746cf req-675cb31d-3c85-4099-8020-514c4ca29c66 service nova] Creating event network-vif-deleted:d6ac6671-38e6-49a1-ba35-e903ffc15afa for instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 on user Apr 17 10:36:42 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-f180a9ab-6aa6-469d-812c-f592ba7746cf req-675cb31d-3c85-4099-8020-514c4ca29c66 service nova] Creating event network-vif-unplugged:7124043d-665c-4a42-a041-b91ccc237b63 for instance 59fd26de-d46e-4f41-91f6-090005a07d99 on user Apr 17 10:36:42 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-f180a9ab-6aa6-469d-812c-f592ba7746cf req-675cb31d-3c85-4099-8020-514c4ca29c66 service nova] Creating event network-vif-plugged:7124043d-665c-4a42-a041-b91ccc237b63 for instance 59fd26de-d46e-4f41-91f6-090005a07d99 on user Apr 17 10:36:42 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-f180a9ab-6aa6-469d-812c-f592ba7746cf req-675cb31d-3c85-4099-8020-514c4ca29c66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.039197 Apr 17 10:36:42 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 64/194] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:36:42 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:44 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-f845d1ad-2bd7-4311-b673-8dcfe199e3f2 req-6e347b03-0b6e-40cc-97ab-fc811a5f1fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4315753-415c-45cd-b06f-da1e3ccc6e4d", "tag": "cd279a0c-99eb-4e32-876e-6d2208cc1db2"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-f845d1ad-2bd7-4311-b673-8dcfe199e3f2 req-6e347b03-0b6e-40cc-97ab-fc811a5f1fe6 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-f845d1ad-2bd7-4311-b673-8dcfe199e3f2 req-6e347b03-0b6e-40cc-97ab-fc811a5f1fe6 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-f845d1ad-2bd7-4311-b673-8dcfe199e3f2 req-6e347b03-0b6e-40cc-97ab-fc811a5f1fe6 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:44 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.compute.server_external_events [req-f845d1ad-2bd7-4311-b673-8dcfe199e3f2 req-6e347b03-0b6e-40cc-97ab-fc811a5f1fe6 service nova] Unable to find a host for instance c4315753-415c-45cd-b06f-da1e3ccc6e4d. Dropping event network-changed {{(pid=72744) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 17 10:36:44 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-f845d1ad-2bd7-4311-b673-8dcfe199e3f2 req-6e347b03-0b6e-40cc-97ab-fc811a5f1fe6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 176 microversion: 2.1 time: 0.030210 Apr 17 10:36:44 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 62/195] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:36:44 2023] POST /compute/v2.1/os-server-external-events => generated 176 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 17 10:36:52 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-79132a78-7e4d-44c3-ae59-eaee9906cac9 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:36:52 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-79132a78-7e4d-44c3-ae59-eaee9906cac9 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:36:52 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:36:52 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=36 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:36:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-79132a78-7e4d-44c3-ae59-eaee9906cac9 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-79132a78-7e4d-44c3-ae59-eaee9906cac9 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-79132a78-7e4d-44c3-ae59-eaee9906cac9 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-79132a78-7e4d-44c3-ae59-eaee9906cac9 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-79132a78-7e4d-44c3-ae59-eaee9906cac9 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-79132a78-7e4d-44c3-ae59-eaee9906cac9 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:53 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-79132a78-7e4d-44c3-ae59-eaee9906cac9 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.170320 Apr 17 10:36:53 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 70/196] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 17 10:36:52 2023] GET /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/os-interface => generated 283 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:54 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=5 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:36:54 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=5 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:36:54 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-c0b7d7b3-daaf-40a2-8545-c9b248e93934 req-1a44d27e-c498-4190-ba88-113db6dbbf6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d", "tag": "01527ff5-7a84-4bbf-ae89-ef334a97fc0a"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:54 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-c0b7d7b3-daaf-40a2-8545-c9b248e93934 req-1a44d27e-c498-4190-ba88-113db6dbbf6a service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:54 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-c0b7d7b3-daaf-40a2-8545-c9b248e93934 req-1a44d27e-c498-4190-ba88-113db6dbbf6a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:54 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-c0b7d7b3-daaf-40a2-8545-c9b248e93934 req-1a44d27e-c498-4190-ba88-113db6dbbf6a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:54 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-c0b7d7b3-daaf-40a2-8545-c9b248e93934 req-1a44d27e-c498-4190-ba88-113db6dbbf6a service nova] Creating event network-changed:01527ff5-7a84-4bbf-ae89-ef334a97fc0a for instance 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d on user Apr 17 10:36:54 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-c0b7d7b3-daaf-40a2-8545-c9b248e93934 req-1a44d27e-c498-4190-ba88-113db6dbbf6a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038553 Apr 17 10:36:54 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 65/197] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:36:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:54 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9c51694-0e80-4e17-8d79-5c0c1563a356"}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:54 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:36:54 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:54 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:54 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:54 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:54 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:54 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:54 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-8f603b28-510e-4ecc-9980-9efb15971662 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270345 Apr 17 10:36:54 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 63/198] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Apr 17 10:36:54 2023] POST /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 10:36:54 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-b2fbfb89-a1c3-4e60-866e-f2ea620dcdc0 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:36:54 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-b2fbfb89-a1c3-4e60-866e-f2ea620dcdc0 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:36:54 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b2fbfb89-a1c3-4e60-866e-f2ea620dcdc0 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:54 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b2fbfb89-a1c3-4e60-866e-f2ea620dcdc0 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:54 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b2fbfb89-a1c3-4e60-866e-f2ea620dcdc0 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:54 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b2fbfb89-a1c3-4e60-866e-f2ea620dcdc0 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:54 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b2fbfb89-a1c3-4e60-866e-f2ea620dcdc0 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:54 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b2fbfb89-a1c3-4e60-866e-f2ea620dcdc0 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:54 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-b2fbfb89-a1c3-4e60-866e-f2ea620dcdc0 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.156128 Apr 17 10:36:54 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 71/199] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 17 10:36:54 2023] GET /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/os-interface => generated 283 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:56 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-a61e251b-514b-462d-84f0-69f5f5f77540 req-80010d81-d01e-4242-a991-38e9558b0d9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab", "tag": "6289bf49-e33d-4ce9-bac7-376417d7abb8"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-a61e251b-514b-462d-84f0-69f5f5f77540 req-80010d81-d01e-4242-a991-38e9558b0d9d service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-a61e251b-514b-462d-84f0-69f5f5f77540 req-80010d81-d01e-4242-a991-38e9558b0d9d service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-a61e251b-514b-462d-84f0-69f5f5f77540 req-80010d81-d01e-4242-a991-38e9558b0d9d service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:56 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-a61e251b-514b-462d-84f0-69f5f5f77540 req-80010d81-d01e-4242-a991-38e9558b0d9d service nova] Creating event network-changed:6289bf49-e33d-4ce9-bac7-376417d7abb8 for instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab on user Apr 17 10:36:56 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-a61e251b-514b-462d-84f0-69f5f5f77540 req-80010d81-d01e-4242-a991-38e9558b0d9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035481 Apr 17 10:36:56 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 66/200] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:36:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:36:57 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "510fd9d0-e377-4ace-8f40-485a192ec2d6"}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:36:57 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:36:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:36:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:36:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:36:58 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-25edbcea-e603-4cdc-9c7b-ce592b636bc4 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300428 Apr 17 10:36:58 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 64/201] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Apr 17 10:36:57 2023] POST /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:37:02 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "15d9e421-b60b-4e95-8794-1b0ee1777ae2"}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:37:02 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:02 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:02 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:02 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:02 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:02 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:02 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:02 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-27db8b95-14fc-46ac-af44-ecab448155f3 tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/os-volume_attachments/c9c51694-0e80-4e17-8d79-5c0c1563a356" status: 202 len: 0 microversion: 2.1 time: 0.426911 Apr 17 10:37:02 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 72/202] 10.0.0.210 () {64 vars in 1510 bytes} [Mon Apr 17 10:37:01 2023] PUT /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/os-volume_attachments/c9c51694-0e80-4e17-8d79-5c0c1563a356 => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:37:05 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-098565e9-8a55-4b0d-af86-eb2af49dd744 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:05 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-098565e9-8a55-4b0d-af86-eb2af49dd744 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:05 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-098565e9-8a55-4b0d-af86-eb2af49dd744 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:05 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-098565e9-8a55-4b0d-af86-eb2af49dd744 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:05 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-098565e9-8a55-4b0d-af86-eb2af49dd744 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:05 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-098565e9-8a55-4b0d-af86-eb2af49dd744 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:05 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-098565e9-8a55-4b0d-af86-eb2af49dd744 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:05 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-098565e9-8a55-4b0d-af86-eb2af49dd744 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:05 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-098565e9-8a55-4b0d-af86-eb2af49dd744 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044114 Apr 17 10:37:05 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 67/203] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:37:05 2023] GET /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:37:05 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:05 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:06 user devstack@n-api.service[72744]: DEBUG nova.objects.instance [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lazy-loading 'services' on Instance uuid 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab {{(pid=72744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 10:37:06 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-cb659522-c05f-41c8-9b2e-2b8cf8045ecc tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/os-volume_attachments/510fd9d0-e377-4ace-8f40-485a192ec2d6" status: 202 len: 0 microversion: 2.1 time: 0.234139 Apr 17 10:37:06 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 65/204] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Apr 17 10:37:05 2023] DELETE /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/os-volume_attachments/510fd9d0-e377-4ace-8f40-485a192ec2d6 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:37:08 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-d9d4eccb-2330-4813-a11c-2ae4e3cc1a90 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:08 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-d9d4eccb-2330-4813-a11c-2ae4e3cc1a90 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d9d4eccb-2330-4813-a11c-2ae4e3cc1a90 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d9d4eccb-2330-4813-a11c-2ae4e3cc1a90 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d9d4eccb-2330-4813-a11c-2ae4e3cc1a90 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d9d4eccb-2330-4813-a11c-2ae4e3cc1a90 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d9d4eccb-2330-4813-a11c-2ae4e3cc1a90 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d9d4eccb-2330-4813-a11c-2ae4e3cc1a90 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:08 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-d9d4eccb-2330-4813-a11c-2ae4e3cc1a90 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048274 Apr 17 10:37:08 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 73/205] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:37:08 2023] GET /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 17 10:37:08 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-8472aff0-c1ae-44c6-b919-2fa2991bbb9f tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:08 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-8472aff0-c1ae-44c6-b919-2fa2991bbb9f tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8472aff0-c1ae-44c6-b919-2fa2991bbb9f tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8472aff0-c1ae-44c6-b919-2fa2991bbb9f tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8472aff0-c1ae-44c6-b919-2fa2991bbb9f tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8472aff0-c1ae-44c6-b919-2fa2991bbb9f tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8472aff0-c1ae-44c6-b919-2fa2991bbb9f tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8472aff0-c1ae-44c6-b919-2fa2991bbb9f tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:08 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-8472aff0-c1ae-44c6-b919-2fa2991bbb9f tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044736 Apr 17 10:37:08 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 68/206] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:37:08 2023] GET /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 17 10:37:08 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:08 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:08 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:37:08 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:08 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:08 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:08 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:08 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:08 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:08 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=9,nova_cell1:INSERT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:37:08 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Going to try to terminate instance {{(pid=72744) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:37:08 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-41532a69-d1b1-4274-8bb9-e707c44f3c71 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" status: 204 len: 0 microversion: 2.1 time: 0.114310 Apr 17 10:37:08 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 66/207] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:37:08 2023] DELETE /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:37:08 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-da1644ea-d23b-48ce-aaff-6860c05c85eb tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:08 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-da1644ea-d23b-48ce-aaff-6860c05c85eb tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-da1644ea-d23b-48ce-aaff-6860c05c85eb tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-da1644ea-d23b-48ce-aaff-6860c05c85eb tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-da1644ea-d23b-48ce-aaff-6860c05c85eb tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-da1644ea-d23b-48ce-aaff-6860c05c85eb tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-da1644ea-d23b-48ce-aaff-6860c05c85eb tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-da1644ea-d23b-48ce-aaff-6860c05c85eb tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:09 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-da1644ea-d23b-48ce-aaff-6860c05c85eb tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a9df3167c7947aab20f7c2ef837fe92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50344f2e70ef48de8fbf64d408e61210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:37:09 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-da1644ea-d23b-48ce-aaff-6860c05c85eb tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" status: 200 len: 1673 microversion: 2.1 time: 0.329223 Apr 17 10:37:09 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 74/208] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:37:08 2023] GET /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab => generated 1673 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:37:09 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-4173ae96-4b35-46b9-b897-2a1e02431cea req-500efbd2-893e-4307-8b06-ec7cdb27527e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab", "name": "network-vif-unplugged", "status": "completed", "tag": "6289bf49-e33d-4ce9-bac7-376417d7abb8"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:37:09 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-4173ae96-4b35-46b9-b897-2a1e02431cea req-500efbd2-893e-4307-8b06-ec7cdb27527e service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:09 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-4173ae96-4b35-46b9-b897-2a1e02431cea req-500efbd2-893e-4307-8b06-ec7cdb27527e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:09 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-4173ae96-4b35-46b9-b897-2a1e02431cea req-500efbd2-893e-4307-8b06-ec7cdb27527e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:09 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-4173ae96-4b35-46b9-b897-2a1e02431cea req-500efbd2-893e-4307-8b06-ec7cdb27527e service nova] Creating event network-vif-unplugged:6289bf49-e33d-4ce9-bac7-376417d7abb8 for instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab on user Apr 17 10:37:09 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-4173ae96-4b35-46b9-b897-2a1e02431cea req-500efbd2-893e-4307-8b06-ec7cdb27527e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030732 Apr 17 10:37:09 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 69/209] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:37:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:37:11 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-7dfec483-d5d7-4bcc-bbb3-9d6e7b9e7bda req-b9092e52-25a5-473c-a787-33c8e0857a1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab", "name": "network-vif-plugged", "status": "completed", "tag": "6289bf49-e33d-4ce9-bac7-376417d7abb8"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:37:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-7dfec483-d5d7-4bcc-bbb3-9d6e7b9e7bda req-b9092e52-25a5-473c-a787-33c8e0857a1b service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-7dfec483-d5d7-4bcc-bbb3-9d6e7b9e7bda req-b9092e52-25a5-473c-a787-33c8e0857a1b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-7dfec483-d5d7-4bcc-bbb3-9d6e7b9e7bda req-b9092e52-25a5-473c-a787-33c8e0857a1b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-7dfec483-d5d7-4bcc-bbb3-9d6e7b9e7bda req-b9092e52-25a5-473c-a787-33c8e0857a1b service nova] Creating event network-vif-plugged:6289bf49-e33d-4ce9-bac7-376417d7abb8 for instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab on user Apr 17 10:37:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-7dfec483-d5d7-4bcc-bbb3-9d6e7b9e7bda req-b9092e52-25a5-473c-a787-33c8e0857a1b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061848 Apr 17 10:37:11 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 67/210] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:37:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:37:11 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-b31e0da7-6a64-48dd-933d-0da6f2c5d995 req-5e139086-1579-49ba-b832-1ff181cc1f72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab", "name": "network-vif-deleted", "tag": "6289bf49-e33d-4ce9-bac7-376417d7abb8"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:37:11 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-b31e0da7-6a64-48dd-933d-0da6f2c5d995 req-5e139086-1579-49ba-b832-1ff181cc1f72 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:11 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-b31e0da7-6a64-48dd-933d-0da6f2c5d995 req-5e139086-1579-49ba-b832-1ff181cc1f72 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:11 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-b31e0da7-6a64-48dd-933d-0da6f2c5d995 req-5e139086-1579-49ba-b832-1ff181cc1f72 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:11 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-b31e0da7-6a64-48dd-933d-0da6f2c5d995 req-5e139086-1579-49ba-b832-1ff181cc1f72 service nova] Creating event network-vif-deleted:6289bf49-e33d-4ce9-bac7-376417d7abb8 for instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab on user Apr 17 10:37:11 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-b31e0da7-6a64-48dd-933d-0da6f2c5d995 req-5e139086-1579-49ba-b832-1ff181cc1f72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060553 Apr 17 10:37:11 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 75/211] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:37:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:37:14 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-dc85fba2-d69a-46eb-b865-bce0191c0bc8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:14 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-dc85fba2-d69a-46eb-b865-bce0191c0bc8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-dc85fba2-d69a-46eb-b865-bce0191c0bc8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-dc85fba2-d69a-46eb-b865-bce0191c0bc8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-dc85fba2-d69a-46eb-b865-bce0191c0bc8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-dc85fba2-d69a-46eb-b865-bce0191c0bc8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-dc85fba2-d69a-46eb-b865-bce0191c0bc8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-dc85fba2-d69a-46eb-b865-bce0191c0bc8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:14 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-dc85fba2-d69a-46eb-b865-bce0191c0bc8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043066 Apr 17 10:37:14 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 70/212] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:37:14 2023] GET /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:37:14 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-bec34588-419e-488d-b6d1-7c2aacf11cee tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:14 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-bec34588-419e-488d-b6d1-7c2aacf11cee tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-bec34588-419e-488d-b6d1-7c2aacf11cee tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-bec34588-419e-488d-b6d1-7c2aacf11cee tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-bec34588-419e-488d-b6d1-7c2aacf11cee tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-bec34588-419e-488d-b6d1-7c2aacf11cee tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-bec34588-419e-488d-b6d1-7c2aacf11cee tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-bec34588-419e-488d-b6d1-7c2aacf11cee tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:14 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-bec34588-419e-488d-b6d1-7c2aacf11cee tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050302 Apr 17 10:37:14 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 68/213] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:37:14 2023] GET /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:37:14 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "c9c51694-0e80-4e17-8d79-5c0c1563a356"}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:37:14 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:14 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-2af977e5-1798-4a52-b5d4-c12809978b51 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:14 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-2af977e5-1798-4a52-b5d4-c12809978b51 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2af977e5-1798-4a52-b5d4-c12809978b51 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2af977e5-1798-4a52-b5d4-c12809978b51 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2af977e5-1798-4a52-b5d4-c12809978b51 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2af977e5-1798-4a52-b5d4-c12809978b51 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2af977e5-1798-4a52-b5d4-c12809978b51 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2af977e5-1798-4a52-b5d4-c12809978b51 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:14 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-2af977e5-1798-4a52-b5d4-c12809978b51 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43c0aee7b05459d898e0dc2654262fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a793afb3e7045898c59a77975079d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:37:14 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-2af977e5-1798-4a52-b5d4-c12809978b51 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0c707ac-b08f-4f18-8262-e1b79d7e17e1" status: 200 len: 1432 microversion: 2.1 time: 0.237185 Apr 17 10:37:14 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 71/214] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:37:14 2023] GET /compute/v2.1/servers/b0c707ac-b08f-4f18-8262-e1b79d7e17e1 => generated 1432 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:37:14 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-bb7959b0-f2e4-451a-b182-a215c4b41ece tempest-TestVolumeSwap-149120056 tempest-TestVolumeSwap-149120056-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/os-volume_attachments/15d9e421-b60b-4e95-8794-1b0ee1777ae2" status: 202 len: 0 microversion: 2.1 time: 0.271736 Apr 17 10:37:14 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 76/215] 10.0.0.210 () {64 vars in 1510 bytes} [Mon Apr 17 10:37:14 2023] PUT /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/os-volume_attachments/15d9e421-b60b-4e95-8794-1b0ee1777ae2 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 17 10:37:14 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-a7a671fd-0050-44dc-9f30-a9cce36efaeb tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:14 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-a7a671fd-0050-44dc-9f30-a9cce36efaeb tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a7a671fd-0050-44dc-9f30-a9cce36efaeb tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a7a671fd-0050-44dc-9f30-a9cce36efaeb tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a7a671fd-0050-44dc-9f30-a9cce36efaeb tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a7a671fd-0050-44dc-9f30-a9cce36efaeb tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a7a671fd-0050-44dc-9f30-a9cce36efaeb tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a7a671fd-0050-44dc-9f30-a9cce36efaeb tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:15 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-a7a671fd-0050-44dc-9f30-a9cce36efaeb tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea177954e75a45f7ad7c9831ab55375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0c657dc95549a3a3ce94f35bfa91be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:37:15 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-a7a671fd-0050-44dc-9f30-a9cce36efaeb tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735" status: 200 len: 1564 microversion: 2.1 time: 0.219638 Apr 17 10:37:15 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 69/216] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:37:14 2023] GET /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735 => generated 1564 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:37:16 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-f614340d-a152-41f4-a4be-4678a6fdb01f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:16 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-f614340d-a152-41f4-a4be-4678a6fdb01f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f614340d-a152-41f4-a4be-4678a6fdb01f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f614340d-a152-41f4-a4be-4678a6fdb01f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f614340d-a152-41f4-a4be-4678a6fdb01f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f614340d-a152-41f4-a4be-4678a6fdb01f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f614340d-a152-41f4-a4be-4678a6fdb01f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f614340d-a152-41f4-a4be-4678a6fdb01f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:16 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-f614340d-a152-41f4-a4be-4678a6fdb01f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:37:16 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-f614340d-a152-41f4-a4be-4678a6fdb01f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:37:16 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-f614340d-a152-41f4-a4be-4678a6fdb01f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:37:16 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-f614340d-a152-41f4-a4be-4678a6fdb01f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/60008675-7786-4a26-9640-49da6efd0adb" status: 200 len: 1690 microversion: 2.87 time: 0.314489 Apr 17 10:37:16 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 72/217] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:37:16 2023] GET /compute/v2.1/servers/60008675-7786-4a26-9640-49da6efd0adb => generated 1690 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:37:19 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-16fc357d-d7d0-4594-98a4-996e62491773 req-099982a6-8ede-4dba-9e05-92003579ce25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7792cf72-dc73-4201-9501-4515ce860735", "tag": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:37:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-16fc357d-d7d0-4594-98a4-996e62491773 req-099982a6-8ede-4dba-9e05-92003579ce25 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-16fc357d-d7d0-4594-98a4-996e62491773 req-099982a6-8ede-4dba-9e05-92003579ce25 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-16fc357d-d7d0-4594-98a4-996e62491773 req-099982a6-8ede-4dba-9e05-92003579ce25 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:19 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-16fc357d-d7d0-4594-98a4-996e62491773 req-099982a6-8ede-4dba-9e05-92003579ce25 service nova] Creating event network-changed:7d50333e-fed3-47d0-9aaf-bd1ab7238d62 for instance 7792cf72-dc73-4201-9501-4515ce860735 on user Apr 17 10:37:19 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-16fc357d-d7d0-4594-98a4-996e62491773 req-099982a6-8ede-4dba-9e05-92003579ce25 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030676 Apr 17 10:37:19 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 77/218] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:37:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:37:19 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cb32346-a238-439d-8ae8-b87c782d41d4"}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:37:19 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:20 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-5f56c7c3-5672-453c-87b5-9c9cf180eed5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.669258 Apr 17 10:37:20 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 70/219] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Apr 17 10:37:19 2023] POST /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments => generated 194 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:37:25 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-e3122343-e41f-4e54-b33e-11d4a4610ff0 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:25 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-e3122343-e41f-4e54-b33e-11d4a4610ff0 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:25 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=19 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:37:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e3122343-e41f-4e54-b33e-11d4a4610ff0 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e3122343-e41f-4e54-b33e-11d4a4610ff0 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e3122343-e41f-4e54-b33e-11d4a4610ff0 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e3122343-e41f-4e54-b33e-11d4a4610ff0 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e3122343-e41f-4e54-b33e-11d4a4610ff0 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e3122343-e41f-4e54-b33e-11d4a4610ff0 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:26 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=37 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:37:26 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-e3122343-e41f-4e54-b33e-11d4a4610ff0 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:37:26 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-e3122343-e41f-4e54-b33e-11d4a4610ff0 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:37:26 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-e3122343-e41f-4e54-b33e-11d4a4610ff0 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:37:26 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-e3122343-e41f-4e54-b33e-11d4a4610ff0 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d" status: 200 len: 1647 microversion: 2.20 time: 0.222173 Apr 17 10:37:26 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 73/220] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:37:25 2023] GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d => generated 1647 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:37:26 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-a48beec4-f2b1-4b73-bcd9-102e509c5761 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:26 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-a48beec4-f2b1-4b73-bcd9-102e509c5761 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:26 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=17 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:37:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a48beec4-f2b1-4b73-bcd9-102e509c5761 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a48beec4-f2b1-4b73-bcd9-102e509c5761 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a48beec4-f2b1-4b73-bcd9-102e509c5761 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a48beec4-f2b1-4b73-bcd9-102e509c5761 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a48beec4-f2b1-4b73-bcd9-102e509c5761 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a48beec4-f2b1-4b73-bcd9-102e509c5761 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:26 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:37:26 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-a48beec4-f2b1-4b73-bcd9-102e509c5761 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] 10.0.0.210 "GET /compute/v2.1/servers/250f2cd2-b6ba-4a89-921f-cbd21ac36525/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.354464 Apr 17 10:37:26 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 78/221] 10.0.0.210 () {64 vars in 1393 bytes} [Mon Apr 17 10:37:26 2023] GET /compute/v2.1/servers/250f2cd2-b6ba-4a89-921f-cbd21ac36525/os-interface => generated 1830 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:37:27 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-2a9401db-43e1-4bdd-ae47-aa14a5d3a1cd tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:27 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-2a9401db-43e1-4bdd-ae47-aa14a5d3a1cd tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:27 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2a9401db-43e1-4bdd-ae47-aa14a5d3a1cd tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:27 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2a9401db-43e1-4bdd-ae47-aa14a5d3a1cd tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:27 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2a9401db-43e1-4bdd-ae47-aa14a5d3a1cd tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:27 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2a9401db-43e1-4bdd-ae47-aa14a5d3a1cd tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:27 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2a9401db-43e1-4bdd-ae47-aa14a5d3a1cd tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:27 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2a9401db-43e1-4bdd-ae47-aa14a5d3a1cd tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:27 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-e9c3ca70-88da-40ce-8cdc-7679ae36f19e req-a62749c2-9f44-4378-a414-082f7c5c3c56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "tag": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:37:27 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-e9c3ca70-88da-40ce-8cdc-7679ae36f19e req-a62749c2-9f44-4378-a414-082f7c5c3c56 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:27 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-e9c3ca70-88da-40ce-8cdc-7679ae36f19e req-a62749c2-9f44-4378-a414-082f7c5c3c56 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:27 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-e9c3ca70-88da-40ce-8cdc-7679ae36f19e req-a62749c2-9f44-4378-a414-082f7c5c3c56 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:27 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-e9c3ca70-88da-40ce-8cdc-7679ae36f19e req-a62749c2-9f44-4378-a414-082f7c5c3c56 service nova] Creating event network-changed:4ea57433-f4d1-4edf-ac36-c8099ce1cd8e for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:37:27 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-e9c3ca70-88da-40ce-8cdc-7679ae36f19e req-a62749c2-9f44-4378-a414-082f7c5c3c56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032044 Apr 17 10:37:27 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 74/222] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:37:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:37:27 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-63aaa334-724c-4500-b2e6-87ca4bb2f070 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:27 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-63aaa334-724c-4500-b2e6-87ca4bb2f070 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-63aaa334-724c-4500-b2e6-87ca4bb2f070 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-63aaa334-724c-4500-b2e6-87ca4bb2f070 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-63aaa334-724c-4500-b2e6-87ca4bb2f070 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-63aaa334-724c-4500-b2e6-87ca4bb2f070 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-63aaa334-724c-4500-b2e6-87ca4bb2f070 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-63aaa334-724c-4500-b2e6-87ca4bb2f070 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:27 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-dce90760-2d0c-41d2-acea-8e1af976bd11 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Calling method '.version_select at 0x7fc55ad96320>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:27 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-dce90760-2d0c-41d2-acea-8e1af976bd11 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] 10.0.0.210 "GET /compute/v2.1/images/1d484d43-a1db-4806-ae9e-7be2347dbfec" status: 200 len: 1724 microversion: 2.1 time: 0.061020 Apr 17 10:37:27 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 75/223] 10.0.0.210 () {62 vars in 1310 bytes} [Mon Apr 17 10:37:27 2023] GET /compute/v2.1/images/1d484d43-a1db-4806-ae9e-7be2347dbfec => generated 1724 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:37:27 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-17f629c8-c8d9-4355-9618-3ad2cbe5833f tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Calling method '.version_select at 0x7fc55ad0eb90>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:27 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-17f629c8-c8d9-4355-9618-3ad2cbe5833f tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] 10.0.0.210 "GET /compute/v2.1/images/1d484d43-a1db-4806-ae9e-7be2347dbfec" status: 200 len: 1724 microversion: 2.1 time: 0.051470 Apr 17 10:37:27 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 76/224] 10.0.0.210 () {62 vars in 1310 bytes} [Mon Apr 17 10:37:27 2023] GET /compute/v2.1/images/1d484d43-a1db-4806-ae9e-7be2347dbfec => generated 1724 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 17 10:37:27 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-2df2c5a4-3062-436e-982c-9bd09f6dd780 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:27 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-2df2c5a4-3062-436e-982c-9bd09f6dd780 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:27 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2df2c5a4-3062-436e-982c-9bd09f6dd780 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:27 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2df2c5a4-3062-436e-982c-9bd09f6dd780 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:27 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2df2c5a4-3062-436e-982c-9bd09f6dd780 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:27 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2df2c5a4-3062-436e-982c-9bd09f6dd780 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:27 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2df2c5a4-3062-436e-982c-9bd09f6dd780 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:27 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2df2c5a4-3062-436e-982c-9bd09f6dd780 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:27 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-63aaa334-724c-4500-b2e6-87ca4bb2f070 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa1a7dc224ec4bd8ebd5fdef1fbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d324884a4e5785c896d76b2a9376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:37:27 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-63aaa334-724c-4500-b2e6-87ca4bb2f070 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41eaa1a7dc224ec4bd8ebd5fdef1fbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d324884a4e5785c896d76b2a9376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:37:27 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-63aaa334-724c-4500-b2e6-87ca4bb2f070 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41eaa1a7dc224ec4bd8ebd5fdef1fbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d324884a4e5785c896d76b2a9376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:37:27 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-63aaa334-724c-4500-b2e6-87ca4bb2f070 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] 10.0.0.210 "GET /compute/v2.1/servers/250f2cd2-b6ba-4a89-921f-cbd21ac36525" status: 200 len: 2819 microversion: 2.32 time: 0.248924 Apr 17 10:37:27 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 79/225] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:37:27 2023] GET /compute/v2.1/servers/250f2cd2-b6ba-4a89-921f-cbd21ac36525 => generated 2819 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:37:27 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-2a9401db-43e1-4bdd-ae47-aa14a5d3a1cd tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f120f04-ecbf-496e-81c9-dcfed9084064/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.479587 Apr 17 10:37:27 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 71/226] 10.0.0.210 () {64 vars in 1393 bytes} [Mon Apr 17 10:37:27 2023] GET /compute/v2.1/servers/1f120f04-ecbf-496e-81c9-dcfed9084064/os-interface => generated 1828 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:37:27 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-b7d8dcfe-6047-4f2f-9949-d7da29b7b271 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:27 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-b7d8dcfe-6047-4f2f-9949-d7da29b7b271 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b7d8dcfe-6047-4f2f-9949-d7da29b7b271 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b7d8dcfe-6047-4f2f-9949-d7da29b7b271 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b7d8dcfe-6047-4f2f-9949-d7da29b7b271 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b7d8dcfe-6047-4f2f-9949-d7da29b7b271 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b7d8dcfe-6047-4f2f-9949-d7da29b7b271 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b7d8dcfe-6047-4f2f-9949-d7da29b7b271 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:28 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-b7d8dcfe-6047-4f2f-9949-d7da29b7b271 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] 10.0.0.210 "GET /compute/v2.1/servers/250f2cd2-b6ba-4a89-921f-cbd21ac36525/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.120133 Apr 17 10:37:28 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 80/227] 10.0.0.210 () {64 vars in 1393 bytes} [Mon Apr 17 10:37:27 2023] GET /compute/v2.1/servers/250f2cd2-b6ba-4a89-921f-cbd21ac36525/os-interface => generated 1830 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:37:28 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-2df2c5a4-3062-436e-982c-9bd09f6dd780 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282298df65264595b5d7351066128b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850462faec874544bdc01dd14746d558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:37:28 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-2df2c5a4-3062-436e-982c-9bd09f6dd780 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" status: 200 len: 1669 microversion: 2.1 time: 0.342919 Apr 17 10:37:28 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 77/228] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:37:27 2023] GET /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 => generated 1669 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 17 10:37:28 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-dc7e0592-d0ec-493c-b377-d065452e2098 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:28 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-dc7e0592-d0ec-493c-b377-d065452e2098 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dc7e0592-d0ec-493c-b377-d065452e2098 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dc7e0592-d0ec-493c-b377-d065452e2098 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dc7e0592-d0ec-493c-b377-d065452e2098 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dc7e0592-d0ec-493c-b377-d065452e2098 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dc7e0592-d0ec-493c-b377-d065452e2098 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dc7e0592-d0ec-493c-b377-d065452e2098 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:28 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-dc7e0592-d0ec-493c-b377-d065452e2098 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040888 Apr 17 10:37:28 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 72/229] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:37:28 2023] GET /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:37:28 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-2cd22322-e756-48bd-abf4-2c8da82650af tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:28 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-2cd22322-e756-48bd-abf4-2c8da82650af tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2cd22322-e756-48bd-abf4-2c8da82650af tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2cd22322-e756-48bd-abf4-2c8da82650af tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2cd22322-e756-48bd-abf4-2c8da82650af tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2cd22322-e756-48bd-abf4-2c8da82650af tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2cd22322-e756-48bd-abf4-2c8da82650af tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2cd22322-e756-48bd-abf4-2c8da82650af tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:28 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-2cd22322-e756-48bd-abf4-2c8da82650af tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041214 Apr 17 10:37:28 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 81/230] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:37:28 2023] GET /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:37:28 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-3c837950-35d8-4d07-a9fd-7e7c791dc2b0 req-59b51d8a-1289-485d-b7a7-9ff98a9609a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "tag": "acaf0b67-4938-4a01-ac74-86f0935046eb"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:37:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-3c837950-35d8-4d07-a9fd-7e7c791dc2b0 req-59b51d8a-1289-485d-b7a7-9ff98a9609a1 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-3c837950-35d8-4d07-a9fd-7e7c791dc2b0 req-59b51d8a-1289-485d-b7a7-9ff98a9609a1 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-3c837950-35d8-4d07-a9fd-7e7c791dc2b0 req-59b51d8a-1289-485d-b7a7-9ff98a9609a1 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:28 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-3c837950-35d8-4d07-a9fd-7e7c791dc2b0 req-59b51d8a-1289-485d-b7a7-9ff98a9609a1 service nova] Creating event network-changed:acaf0b67-4938-4a01-ac74-86f0935046eb for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:37:28 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-3c837950-35d8-4d07-a9fd-7e7c791dc2b0 req-59b51d8a-1289-485d-b7a7-9ff98a9609a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030998 Apr 17 10:37:28 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 78/231] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:37:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:37:28 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-27f97aa8-23a9-40b3-91df-5dd79371e428 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:28 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-27f97aa8-23a9-40b3-91df-5dd79371e428 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-27f97aa8-23a9-40b3-91df-5dd79371e428 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-27f97aa8-23a9-40b3-91df-5dd79371e428 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-27f97aa8-23a9-40b3-91df-5dd79371e428 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-27f97aa8-23a9-40b3-91df-5dd79371e428 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-27f97aa8-23a9-40b3-91df-5dd79371e428 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-27f97aa8-23a9-40b3-91df-5dd79371e428 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:28 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:28 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:28 user devstack@n-api.service[72745]: DEBUG nova.objects.instance [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lazy-loading 'services' on Instance uuid 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d {{(pid=72745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 10:37:29 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-76c6ff84-214e-4e64-a215-f50dd5a4f1c8 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/os-volume_attachments/c9c51694-0e80-4e17-8d79-5c0c1563a356" status: 202 len: 0 microversion: 2.1 time: 0.246642 Apr 17 10:37:29 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 82/232] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Apr 17 10:37:28 2023] DELETE /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/os-volume_attachments/c9c51694-0e80-4e17-8d79-5c0c1563a356 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:37:29 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-3a8e3fc2-3ed6-4550-9118-512a94c676c4 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:29 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-3a8e3fc2-3ed6-4550-9118-512a94c676c4 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3a8e3fc2-3ed6-4550-9118-512a94c676c4 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3a8e3fc2-3ed6-4550-9118-512a94c676c4 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3a8e3fc2-3ed6-4550-9118-512a94c676c4 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3a8e3fc2-3ed6-4550-9118-512a94c676c4 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3a8e3fc2-3ed6-4550-9118-512a94c676c4 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3a8e3fc2-3ed6-4550-9118-512a94c676c4 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-fa4ce3e7-3db9-40d2-a52c-27990bfbb2ac tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-fa4ce3e7-3db9-40d2-a52c-27990bfbb2ac tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-fa4ce3e7-3db9-40d2-a52c-27990bfbb2ac tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-fa4ce3e7-3db9-40d2-a52c-27990bfbb2ac tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-fa4ce3e7-3db9-40d2-a52c-27990bfbb2ac tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-fa4ce3e7-3db9-40d2-a52c-27990bfbb2ac tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-fa4ce3e7-3db9-40d2-a52c-27990bfbb2ac tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-fa4ce3e7-3db9-40d2-a52c-27990bfbb2ac tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:29 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-3a8e3fc2-3ed6-4550-9118-512a94c676c4 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044171 Apr 17 10:37:29 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 79/233] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:37:29 2023] GET /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:37:29 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-fa4ce3e7-3db9-40d2-a52c-27990bfbb2ac tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] HTTP exception thrown: Instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 could not be found. Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-fa4ce3e7-3db9-40d2-a52c-27990bfbb2ac tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Request method failure captured: Apr 17 10:37:29 user devstack@n-api.service[72745]: request: GET /compute/v2.1/servers/6cc638ee-d494-4523-8d12-9ede0853ecd6 HTTP/1.1 Apr 17 10:37:29 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:37:29 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:37:29 user devstack@n-api.service[72745]: Connection: close Apr 17 10:37:29 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 10:37:29 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:37:29 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:37:29 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:37:29 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSC1UqirYN0aHscl7uZt47AHwAX2m6c5qUFJVJvL4mvmxXtQTnehi0qZPE6QHhfJhgxJU0z7UKFVwndNoBZnNH5zqbtL8dLYrtyfLPinRx6Nb1AYo_Dn_U9DE_SlRVq4-MlJ61t19NOKJyujV-0dUBve37Qe0VnPnAfxz7pMCPT1Jxw Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Project-Id: 02daa1fd267646fbb4f726b247ba4a6b Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Project-Name: tempest-DeleteServersTestJSON-1683071550 Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/02daa1fd267646fbb4f726b247ba4a6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/02daa1fd267646fbb4f726b247ba4a6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/02daa1fd267646fbb4f726b247ba4a6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Tenant: tempest-DeleteServersTestJSON-1683071550 Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Tenant-Id: 02daa1fd267646fbb4f726b247ba4a6b Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-DeleteServersTestJSON-1683071550 Apr 17 10:37:29 user devstack@n-api.service[72745]: X-User: tempest-DeleteServersTestJSON-1683071550-project-member Apr 17 10:37:29 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:37:29 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:37:29 user devstack@n-api.service[72745]: X-User-Id: 7f4863ef9d61412a997abf4f27cce1b7 Apr 17 10:37:29 user devstack@n-api.service[72745]: X-User-Name: tempest-DeleteServersTestJSON-1683071550-project-member Apr 17 10:37:29 user devstack@n-api.service[72745]: method: > Apr 17 10:37:29 user devstack@n-api.service[72745]: exception: Instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 could not be found. Apr 17 10:37:29 user devstack@n-api.service[72745]: action_args: {'id': '6cc638ee-d494-4523-8d12-9ede0853ecd6'} Apr 17 10:37:29 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 could not be found. Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 could not be found. Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 could not be found. Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-fa4ce3e7-3db9-40d2-a52c-27990bfbb2ac tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Returning 404 to user: Instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:37:29 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-fa4ce3e7-3db9-40d2-a52c-27990bfbb2ac tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cc638ee-d494-4523-8d12-9ede0853ecd6" status: 404 len: 111 microversion: 2.1 time: 0.047126 Apr 17 10:37:29 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 83/234] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:37:29 2023] GET /compute/v2.1/servers/6cc638ee-d494-4523-8d12-9ede0853ecd6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:37:29 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:29 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:29 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Going to try to terminate instance {{(pid=72743) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-e9d7e922-bd60-4585-803f-389a22b1c98f tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-e9d7e922-bd60-4585-803f-389a22b1c98f tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e9d7e922-bd60-4585-803f-389a22b1c98f tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e9d7e922-bd60-4585-803f-389a22b1c98f tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e9d7e922-bd60-4585-803f-389a22b1c98f tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e9d7e922-bd60-4585-803f-389a22b1c98f tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e9d7e922-bd60-4585-803f-389a22b1c98f tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e9d7e922-bd60-4585-803f-389a22b1c98f tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:29 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-e9d7e922-bd60-4585-803f-389a22b1c98f tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] HTTP exception thrown: Instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 could not be found. Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-e9d7e922-bd60-4585-803f-389a22b1c98f tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Request method failure captured: Apr 17 10:37:29 user devstack@n-api.service[72745]: request: GET /compute/v2.1/servers/6cc638ee-d494-4523-8d12-9ede0853ecd6/os-volume_attachments HTTP/1.1 Apr 17 10:37:29 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:37:29 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:37:29 user devstack@n-api.service[72745]: Connection: close Apr 17 10:37:29 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 10:37:29 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:37:29 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:37:29 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:37:29 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSC1UqirYN0aHscl7uZt47AHwAX2m6c5qUFJVJvL4mvmxXtQTnehi0qZPE6QHhfJhgxJU0z7UKFVwndNoBZnNH5zqbtL8dLYrtyfLPinRx6Nb1AYo_Dn_U9DE_SlRVq4-MlJ61t19NOKJyujV-0dUBve37Qe0VnPnAfxz7pMCPT1Jxw Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Project-Id: 02daa1fd267646fbb4f726b247ba4a6b Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Project-Name: tempest-DeleteServersTestJSON-1683071550 Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/02daa1fd267646fbb4f726b247ba4a6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/02daa1fd267646fbb4f726b247ba4a6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/02daa1fd267646fbb4f726b247ba4a6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Tenant: tempest-DeleteServersTestJSON-1683071550 Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Tenant-Id: 02daa1fd267646fbb4f726b247ba4a6b Apr 17 10:37:29 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-DeleteServersTestJSON-1683071550 Apr 17 10:37:29 user devstack@n-api.service[72745]: X-User: tempest-DeleteServersTestJSON-1683071550-project-member Apr 17 10:37:29 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:37:29 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:37:29 user devstack@n-api.service[72745]: X-User-Id: 7f4863ef9d61412a997abf4f27cce1b7 Apr 17 10:37:29 user devstack@n-api.service[72745]: X-User-Name: tempest-DeleteServersTestJSON-1683071550-project-member Apr 17 10:37:29 user devstack@n-api.service[72745]: method: > Apr 17 10:37:29 user devstack@n-api.service[72745]: exception: Instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 could not be found. Apr 17 10:37:29 user devstack@n-api.service[72745]: action_args: {'server_id': '6cc638ee-d494-4523-8d12-9ede0853ecd6'} Apr 17 10:37:29 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 could not be found. Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 could not be found. Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 could not be found. Apr 17 10:37:29 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-e9d7e922-bd60-4585-803f-389a22b1c98f tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Returning 404 to user: Instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:37:29 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-e9d7e922-bd60-4585-803f-389a22b1c98f tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cc638ee-d494-4523-8d12-9ede0853ecd6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029439 Apr 17 10:37:29 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 84/235] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:37:29 2023] GET /compute/v2.1/servers/6cc638ee-d494-4523-8d12-9ede0853ecd6/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:37:29 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-0166e9d9-7599-4598-a19e-73dfce0c0c92 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/250f2cd2-b6ba-4a89-921f-cbd21ac36525" status: 204 len: 0 microversion: 2.32 time: 0.141002 Apr 17 10:37:29 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 80/236] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 17 10:37:29 2023] DELETE /compute/v2.1/servers/250f2cd2-b6ba-4a89-921f-cbd21ac36525 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-b8481be4-b6b8-4dea-a877-e6c70cb6abe8 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-b8481be4-b6b8-4dea-a877-e6c70cb6abe8 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b8481be4-b6b8-4dea-a877-e6c70cb6abe8 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b8481be4-b6b8-4dea-a877-e6c70cb6abe8 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b8481be4-b6b8-4dea-a877-e6c70cb6abe8 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b8481be4-b6b8-4dea-a877-e6c70cb6abe8 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b8481be4-b6b8-4dea-a877-e6c70cb6abe8 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b8481be4-b6b8-4dea-a877-e6c70cb6abe8 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:29 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-27f97aa8-23a9-40b3-91df-5dd79371e428 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245581ebc4824aa7addd4d4272d4a47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c3233510fa4ef1bb876bd6ee37a443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:37:29 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-27f97aa8-23a9-40b3-91df-5dd79371e428 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245581ebc4824aa7addd4d4272d4a47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c3233510fa4ef1bb876bd6ee37a443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:37:29 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-27f97aa8-23a9-40b3-91df-5dd79371e428 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245581ebc4824aa7addd4d4272d4a47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c3233510fa4ef1bb876bd6ee37a443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:37:29 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-27f97aa8-23a9-40b3-91df-5dd79371e428 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f120f04-ecbf-496e-81c9-dcfed9084064" status: 200 len: 2822 microversion: 2.42 time: 0.603387 Apr 17 10:37:29 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 73/237] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:37:28 2023] GET /compute/v2.1/servers/1f120f04-ecbf-496e-81c9-dcfed9084064 => generated 2822 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:37:29 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-d65646d7-4f1e-4cdb-af19-8f1410ee7e63 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:29 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-d65646d7-4f1e-4cdb-af19-8f1410ee7e63 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d65646d7-4f1e-4cdb-af19-8f1410ee7e63 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d65646d7-4f1e-4cdb-af19-8f1410ee7e63 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d65646d7-4f1e-4cdb-af19-8f1410ee7e63 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d65646d7-4f1e-4cdb-af19-8f1410ee7e63 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d65646d7-4f1e-4cdb-af19-8f1410ee7e63 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d65646d7-4f1e-4cdb-af19-8f1410ee7e63 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:29 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-d65646d7-4f1e-4cdb-af19-8f1410ee7e63 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f120f04-ecbf-496e-81c9-dcfed9084064/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.193621 Apr 17 10:37:29 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 81/238] 10.0.0.210 () {64 vars in 1393 bytes} [Mon Apr 17 10:37:29 2023] GET /compute/v2.1/servers/1f120f04-ecbf-496e-81c9-dcfed9084064/os-interface => generated 1828 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-b8481be4-b6b8-4dea-a877-e6c70cb6abe8 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eaa1a7dc224ec4bd8ebd5fdef1fbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d324884a4e5785c896d76b2a9376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-b8481be4-b6b8-4dea-a877-e6c70cb6abe8 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41eaa1a7dc224ec4bd8ebd5fdef1fbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d324884a4e5785c896d76b2a9376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:37:29 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-b8481be4-b6b8-4dea-a877-e6c70cb6abe8 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41eaa1a7dc224ec4bd8ebd5fdef1fbeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d324884a4e5785c896d76b2a9376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:37:29 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-b8481be4-b6b8-4dea-a877-e6c70cb6abe8 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] 10.0.0.210 "GET /compute/v2.1/servers/250f2cd2-b6ba-4a89-921f-cbd21ac36525" status: 200 len: 2943 microversion: 2.32 time: 0.335841 Apr 17 10:37:29 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 85/239] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:37:29 2023] GET /compute/v2.1/servers/250f2cd2-b6ba-4a89-921f-cbd21ac36525 => generated 2943 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:37:30 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-075e8d8f-3822-4ebf-9f87-df9856400b1d req-86e30a81-d18e-4c74-b4b0-5df53f3b518e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-unplugged", "status": "completed", "tag": "03ae70e4-ee40-4b09-a38b-a819ee74d880"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:37:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-075e8d8f-3822-4ebf-9f87-df9856400b1d req-86e30a81-d18e-4c74-b4b0-5df53f3b518e service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-075e8d8f-3822-4ebf-9f87-df9856400b1d req-86e30a81-d18e-4c74-b4b0-5df53f3b518e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-075e8d8f-3822-4ebf-9f87-df9856400b1d req-86e30a81-d18e-4c74-b4b0-5df53f3b518e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:30 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-075e8d8f-3822-4ebf-9f87-df9856400b1d req-86e30a81-d18e-4c74-b4b0-5df53f3b518e service nova] Creating event network-vif-unplugged:03ae70e4-ee40-4b09-a38b-a819ee74d880 for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:37:30 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-075e8d8f-3822-4ebf-9f87-df9856400b1d req-86e30a81-d18e-4c74-b4b0-5df53f3b518e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049325 Apr 17 10:37:30 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 74/240] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:37:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:37:30 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-229d3f54-5cb5-4d3c-80b4-b3f8f868d9ef req-8230b4b7-ba04-4dcf-8aae-ef6e54ec52b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-unplugged", "status": "completed", "tag": "c3988098-5dbd-47e1-896c-6a2b6415f64d"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:37:30 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-229d3f54-5cb5-4d3c-80b4-b3f8f868d9ef req-8230b4b7-ba04-4dcf-8aae-ef6e54ec52b1 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:30 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-229d3f54-5cb5-4d3c-80b4-b3f8f868d9ef req-8230b4b7-ba04-4dcf-8aae-ef6e54ec52b1 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:30 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-229d3f54-5cb5-4d3c-80b4-b3f8f868d9ef req-8230b4b7-ba04-4dcf-8aae-ef6e54ec52b1 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:30 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-229d3f54-5cb5-4d3c-80b4-b3f8f868d9ef req-8230b4b7-ba04-4dcf-8aae-ef6e54ec52b1 service nova] Creating event network-vif-unplugged:c3988098-5dbd-47e1-896c-6a2b6415f64d for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:37:30 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-229d3f54-5cb5-4d3c-80b4-b3f8f868d9ef req-8230b4b7-ba04-4dcf-8aae-ef6e54ec52b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054796 Apr 17 10:37:30 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 82/241] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:37:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:37:30 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-unplugged", "status": "completed", "tag": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e"}, {"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-plugged", "status": "completed", "tag": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e"}, {"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-unplugged", "status": "completed", "tag": "77da47f6-f251-457d-b4c9-a2687922abc5"}, {"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-plugged", "status": "completed", "tag": "77da47f6-f251-457d-b4c9-a2687922abc5"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:37:30 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:30 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:30 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:30 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] Creating event network-vif-unplugged:4ea57433-f4d1-4edf-ac36-c8099ce1cd8e for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:37:30 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] Creating event network-vif-plugged:4ea57433-f4d1-4edf-ac36-c8099ce1cd8e for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:37:30 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] Creating event network-vif-unplugged:77da47f6-f251-457d-b4c9-a2687922abc5 for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:37:30 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] Creating event network-vif-plugged:77da47f6-f251-457d-b4c9-a2687922abc5 for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:37:30 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-441f6a06-f22c-44a9-92e3-588b458185fd req-d7d6d777-f360-4bda-936d-fc6dbc33b1a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.037654 Apr 17 10:37:30 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 86/242] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:37:30 2023] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:37:30 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:30 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:30 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Going to try to terminate instance {{(pid=72744) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:37:31 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-2b1fd7a5-0f05-47dc-9ede-9db19a145f99 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1f120f04-ecbf-496e-81c9-dcfed9084064" status: 204 len: 0 microversion: 2.42 time: 0.199495 Apr 17 10:37:31 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 75/243] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 17 10:37:30 2023] DELETE /compute/v2.1/servers/1f120f04-ecbf-496e-81c9-dcfed9084064 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 17 10:37:31 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-8f7a7eec-f1a8-4e18-9291-35d912a4c3bd tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:31 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-8f7a7eec-f1a8-4e18-9291-35d912a4c3bd tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8f7a7eec-f1a8-4e18-9291-35d912a4c3bd tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8f7a7eec-f1a8-4e18-9291-35d912a4c3bd tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8f7a7eec-f1a8-4e18-9291-35d912a4c3bd tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8f7a7eec-f1a8-4e18-9291-35d912a4c3bd tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8f7a7eec-f1a8-4e18-9291-35d912a4c3bd tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8f7a7eec-f1a8-4e18-9291-35d912a4c3bd tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:31 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-427108e2-7f6f-418f-8bf7-d4b8d0a9443f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:31 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-427108e2-7f6f-418f-8bf7-d4b8d0a9443f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:31 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-427108e2-7f6f-418f-8bf7-d4b8d0a9443f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:31 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-427108e2-7f6f-418f-8bf7-d4b8d0a9443f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:31 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-427108e2-7f6f-418f-8bf7-d4b8d0a9443f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:31 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-427108e2-7f6f-418f-8bf7-d4b8d0a9443f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:31 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-427108e2-7f6f-418f-8bf7-d4b8d0a9443f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:31 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-427108e2-7f6f-418f-8bf7-d4b8d0a9443f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:31 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-8f7a7eec-f1a8-4e18-9291-35d912a4c3bd tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245581ebc4824aa7addd4d4272d4a47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c3233510fa4ef1bb876bd6ee37a443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:37:31 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-8f7a7eec-f1a8-4e18-9291-35d912a4c3bd tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245581ebc4824aa7addd4d4272d4a47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c3233510fa4ef1bb876bd6ee37a443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:37:31 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-8f7a7eec-f1a8-4e18-9291-35d912a4c3bd tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245581ebc4824aa7addd4d4272d4a47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c3233510fa4ef1bb876bd6ee37a443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:37:31 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-8f7a7eec-f1a8-4e18-9291-35d912a4c3bd tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f120f04-ecbf-496e-81c9-dcfed9084064" status: 200 len: 2946 microversion: 2.42 time: 0.324421 Apr 17 10:37:31 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 83/244] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:37:31 2023] GET /compute/v2.1/servers/1f120f04-ecbf-496e-81c9-dcfed9084064 => generated 2946 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:37:31 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-427108e2-7f6f-418f-8bf7-d4b8d0a9443f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9862432f87f4500a46f32a0b27d54d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a17ec3e1b314acbb701f2d2d27d0560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:37:31 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-427108e2-7f6f-418f-8bf7-d4b8d0a9443f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99" status: 200 len: 1685 microversion: 2.1 time: 0.369055 Apr 17 10:37:31 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 87/245] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:37:31 2023] GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99 => generated 1685 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:37:32 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-plugged", "status": "completed", "tag": "03ae70e4-ee40-4b09-a38b-a819ee74d880"}, {"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-unplugged", "status": "completed", "tag": "acaf0b67-4938-4a01-ac74-86f0935046eb"}, {"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-plugged", "status": "completed", "tag": "acaf0b67-4938-4a01-ac74-86f0935046eb"}, {"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-unplugged", "status": "completed", "tag": "74fde78e-82b3-43f3-9c87-2b754a4bd66f"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:37:32 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:32 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:32 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:32 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] Creating event network-vif-plugged:03ae70e4-ee40-4b09-a38b-a819ee74d880 for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:37:32 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] Creating event network-vif-unplugged:acaf0b67-4938-4a01-ac74-86f0935046eb for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:37:32 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] Creating event network-vif-plugged:acaf0b67-4938-4a01-ac74-86f0935046eb for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:37:32 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] Creating event network-vif-unplugged:74fde78e-82b3-43f3-9c87-2b754a4bd66f for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:37:32 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-fe94d701-3592-4b75-80c3-5bafd1e70eab req-7e4ab2f3-3663-47e7-9472-cadce3cd89f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.045482 Apr 17 10:37:32 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 76/246] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:37:32 2023] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:37:32 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-c7c654ee-4d57-4615-9b52-c7f66640e939 req-2f7b64f6-9fd9-4b74-87cc-0a01e7fbd340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-plugged", "status": "completed", "tag": "c3988098-5dbd-47e1-896c-6a2b6415f64d"}, {"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-unplugged", "status": "completed", "tag": "552d9aee-fdf7-4e99-8521-604486e3f888"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:37:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-c7c654ee-4d57-4615-9b52-c7f66640e939 req-2f7b64f6-9fd9-4b74-87cc-0a01e7fbd340 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-c7c654ee-4d57-4615-9b52-c7f66640e939 req-2f7b64f6-9fd9-4b74-87cc-0a01e7fbd340 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-c7c654ee-4d57-4615-9b52-c7f66640e939 req-2f7b64f6-9fd9-4b74-87cc-0a01e7fbd340 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:32 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-c7c654ee-4d57-4615-9b52-c7f66640e939 req-2f7b64f6-9fd9-4b74-87cc-0a01e7fbd340 service nova] Creating event network-vif-plugged:c3988098-5dbd-47e1-896c-6a2b6415f64d for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:37:32 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-c7c654ee-4d57-4615-9b52-c7f66640e939 req-2f7b64f6-9fd9-4b74-87cc-0a01e7fbd340 service nova] Creating event network-vif-unplugged:552d9aee-fdf7-4e99-8521-604486e3f888 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:37:32 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-c7c654ee-4d57-4615-9b52-c7f66640e939 req-2f7b64f6-9fd9-4b74-87cc-0a01e7fbd340 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.058244 Apr 17 10:37:32 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 84/247] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:37:32 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:37:32 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-unplugged", "status": "completed", "tag": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b"}, {"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-plugged", "status": "completed", "tag": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b"}, {"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-unplugged", "status": "completed", "tag": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38"}, {"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-plugged", "status": "completed", "tag": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38"}, {"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-unplugged", "status": "completed", "tag": "9df6de54-e8fe-425b-a344-de73c3cc5d3e"}, {"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-plugged", "status": "completed", "tag": "9df6de54-e8fe-425b-a344-de73c3cc5d3e"}, {"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-unplugged", "status": "completed", "tag": "5ead9709-8869-4070-81f0-1e397c5ba789"}, {"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-plugged", "status": "completed", "tag": "5ead9709-8869-4070-81f0-1e397c5ba789"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:37:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:32 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Creating event network-vif-unplugged:0ea3a20e-3d8d-4cab-9783-0a22cab2e27b for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:37:32 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Creating event network-vif-plugged:0ea3a20e-3d8d-4cab-9783-0a22cab2e27b for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:37:32 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Creating event network-vif-unplugged:2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38 for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:37:32 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Creating event network-vif-plugged:2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38 for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:37:32 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Creating event network-vif-unplugged:9df6de54-e8fe-425b-a344-de73c3cc5d3e for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:37:32 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Creating event network-vif-plugged:9df6de54-e8fe-425b-a344-de73c3cc5d3e for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:37:32 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Creating event network-vif-unplugged:5ead9709-8869-4070-81f0-1e397c5ba789 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:37:32 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] Creating event network-vif-plugged:5ead9709-8869-4070-81f0-1e397c5ba789 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:37:32 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-32e6f54c-a86f-41c4-ace9-422d03f30a6d req-70975180-00aa-495c-b987-cbd41d30ffa6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1388 microversion: 2.1 time: 0.046931 Apr 17 10:37:32 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 88/248] 10.0.0.210 () {68 vars in 1395 bytes} [Mon Apr 17 10:37:32 2023] POST /compute/v2.1/os-server-external-events => generated 1388 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:37:33 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-1e0abfca-17e4-49a6-bdd9-dfb531b89e1d tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:33 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-1e0abfca-17e4-49a6-bdd9-dfb531b89e1d tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:33 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1e0abfca-17e4-49a6-bdd9-dfb531b89e1d tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:33 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1e0abfca-17e4-49a6-bdd9-dfb531b89e1d tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:33 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1e0abfca-17e4-49a6-bdd9-dfb531b89e1d tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:33 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1e0abfca-17e4-49a6-bdd9-dfb531b89e1d tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:33 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1e0abfca-17e4-49a6-bdd9-dfb531b89e1d tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:33 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1e0abfca-17e4-49a6-bdd9-dfb531b89e1d tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:33 user devstack@n-api.service[72744]: INFO nova.api.openstack.wsgi [None req-1e0abfca-17e4-49a6-bdd9-dfb531b89e1d tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] HTTP exception thrown: Instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 could not be found. Apr 17 10:37:33 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-1e0abfca-17e4-49a6-bdd9-dfb531b89e1d tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Request method failure captured: Apr 17 10:37:33 user devstack@n-api.service[72744]: request: DELETE /compute/v2.1/servers/6cc638ee-d494-4523-8d12-9ede0853ecd6 HTTP/1.1 Apr 17 10:37:33 user devstack@n-api.service[72744]: Accept: application/json Apr 17 10:37:33 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 10:37:33 user devstack@n-api.service[72744]: Connection: close Apr 17 10:37:33 user devstack@n-api.service[72744]: Content-Length: 0 Apr 17 10:37:33 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 10:37:33 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 10:37:33 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 10:37:33 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 10:37:33 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSC1UqirYN0aHscl7uZt47AHwAX2m6c5qUFJVJvL4mvmxXtQTnehi0qZPE6QHhfJhgxJU0z7UKFVwndNoBZnNH5zqbtL8dLYrtyfLPinRx6Nb1AYo_Dn_U9DE_SlRVq4-MlJ61t19NOKJyujV-0dUBve37Qe0VnPnAfxz7pMCPT1Jxw Apr 17 10:37:33 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 10:37:33 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 10:37:33 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 10:37:33 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 10:37:33 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 10:37:33 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 10:37:33 user devstack@n-api.service[72744]: X-Project-Id: 02daa1fd267646fbb4f726b247ba4a6b Apr 17 10:37:33 user devstack@n-api.service[72744]: X-Project-Name: tempest-DeleteServersTestJSON-1683071550 Apr 17 10:37:33 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 10:37:33 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 10:37:33 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/02daa1fd267646fbb4f726b247ba4a6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/02daa1fd267646fbb4f726b247ba4a6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/02daa1fd267646fbb4f726b247ba4a6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:37:33 user devstack@n-api.service[72744]: X-Tenant: tempest-DeleteServersTestJSON-1683071550 Apr 17 10:37:33 user devstack@n-api.service[72744]: X-Tenant-Id: 02daa1fd267646fbb4f726b247ba4a6b Apr 17 10:37:33 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-DeleteServersTestJSON-1683071550 Apr 17 10:37:33 user devstack@n-api.service[72744]: X-User: tempest-DeleteServersTestJSON-1683071550-project-member Apr 17 10:37:33 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 10:37:33 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 10:37:33 user devstack@n-api.service[72744]: X-User-Id: 7f4863ef9d61412a997abf4f27cce1b7 Apr 17 10:37:33 user devstack@n-api.service[72744]: X-User-Name: tempest-DeleteServersTestJSON-1683071550-project-member Apr 17 10:37:33 user devstack@n-api.service[72744]: method: > Apr 17 10:37:33 user devstack@n-api.service[72744]: exception: Instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 could not be found. Apr 17 10:37:33 user devstack@n-api.service[72744]: action_args: {'id': '6cc638ee-d494-4523-8d12-9ede0853ecd6'} Apr 17 10:37:33 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 could not be found. Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 could not be found. Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 could not be found. Apr 17 10:37:33 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:37:33 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-1e0abfca-17e4-49a6-bdd9-dfb531b89e1d tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Returning 404 to user: Instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 could not be found. {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:37:33 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-1e0abfca-17e4-49a6-bdd9-dfb531b89e1d tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6cc638ee-d494-4523-8d12-9ede0853ecd6" status: 404 len: 111 microversion: 2.1 time: 0.036940 Apr 17 10:37:33 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 77/249] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:37:33 2023] DELETE /compute/v2.1/servers/6cc638ee-d494-4523-8d12-9ede0853ecd6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:37:33 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-2056c79b-db9f-4af1-95bb-57cb21dc57b1 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:33 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-2056c79b-db9f-4af1-95bb-57cb21dc57b1 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] [instance: 6cc638ee-d494-4523-8d12-9ede0853ecd6] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:33 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2056c79b-db9f-4af1-95bb-57cb21dc57b1 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:33 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2056c79b-db9f-4af1-95bb-57cb21dc57b1 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:33 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2056c79b-db9f-4af1-95bb-57cb21dc57b1 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:33 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2056c79b-db9f-4af1-95bb-57cb21dc57b1 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:33 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2056c79b-db9f-4af1-95bb-57cb21dc57b1 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:33 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2056c79b-db9f-4af1-95bb-57cb21dc57b1 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:33 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-2056c79b-db9f-4af1-95bb-57cb21dc57b1 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] HTTP exception thrown: Instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 could not be found. Apr 17 10:37:33 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-2056c79b-db9f-4af1-95bb-57cb21dc57b1 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Request method failure captured: Apr 17 10:37:33 user devstack@n-api.service[72743]: request: GET /compute/v2.1/servers/6cc638ee-d494-4523-8d12-9ede0853ecd6 HTTP/1.1 Apr 17 10:37:33 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:37:33 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:37:33 user devstack@n-api.service[72743]: Connection: close Apr 17 10:37:33 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:37:33 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:37:33 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:37:33 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:37:33 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:37:33 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSC1UqirYN0aHscl7uZt47AHwAX2m6c5qUFJVJvL4mvmxXtQTnehi0qZPE6QHhfJhgxJU0z7UKFVwndNoBZnNH5zqbtL8dLYrtyfLPinRx6Nb1AYo_Dn_U9DE_SlRVq4-MlJ61t19NOKJyujV-0dUBve37Qe0VnPnAfxz7pMCPT1Jxw Apr 17 10:37:33 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:37:33 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:37:33 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:37:33 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:37:33 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:37:33 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:37:33 user devstack@n-api.service[72743]: X-Project-Id: 02daa1fd267646fbb4f726b247ba4a6b Apr 17 10:37:33 user devstack@n-api.service[72743]: X-Project-Name: tempest-DeleteServersTestJSON-1683071550 Apr 17 10:37:33 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:37:33 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:37:33 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/02daa1fd267646fbb4f726b247ba4a6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/02daa1fd267646fbb4f726b247ba4a6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/02daa1fd267646fbb4f726b247ba4a6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:37:33 user devstack@n-api.service[72743]: X-Tenant: tempest-DeleteServersTestJSON-1683071550 Apr 17 10:37:33 user devstack@n-api.service[72743]: X-Tenant-Id: 02daa1fd267646fbb4f726b247ba4a6b Apr 17 10:37:33 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-DeleteServersTestJSON-1683071550 Apr 17 10:37:33 user devstack@n-api.service[72743]: X-User: tempest-DeleteServersTestJSON-1683071550-project-member Apr 17 10:37:33 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:37:33 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:37:33 user devstack@n-api.service[72743]: X-User-Id: 7f4863ef9d61412a997abf4f27cce1b7 Apr 17 10:37:33 user devstack@n-api.service[72743]: X-User-Name: tempest-DeleteServersTestJSON-1683071550-project-member Apr 17 10:37:33 user devstack@n-api.service[72743]: method: > Apr 17 10:37:33 user devstack@n-api.service[72743]: exception: Instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 could not be found. Apr 17 10:37:33 user devstack@n-api.service[72743]: action_args: {'id': '6cc638ee-d494-4523-8d12-9ede0853ecd6'} Apr 17 10:37:33 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 could not be found. Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 could not be found. Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 could not be found. Apr 17 10:37:33 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:37:33 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-2056c79b-db9f-4af1-95bb-57cb21dc57b1 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] Returning 404 to user: Instance 6cc638ee-d494-4523-8d12-9ede0853ecd6 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:37:33 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-2056c79b-db9f-4af1-95bb-57cb21dc57b1 tempest-DeleteServersTestJSON-1683071550 tempest-DeleteServersTestJSON-1683071550-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cc638ee-d494-4523-8d12-9ede0853ecd6" status: 404 len: 111 microversion: 2.1 time: 0.042369 Apr 17 10:37:33 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 85/250] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:37:33 2023] GET /compute/v2.1/servers/6cc638ee-d494-4523-8d12-9ede0853ecd6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:37:34 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-plugged", "status": "completed", "tag": "74fde78e-82b3-43f3-9c87-2b754a4bd66f"}, {"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-unplugged", "status": "completed", "tag": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8"}, {"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-plugged", "status": "completed", "tag": "b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8"}, {"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-unplugged", "status": "completed", "tag": "b3872258-192d-4118-b77a-98dee0f21115"}, {"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-plugged", "status": "completed", "tag": "b3872258-192d-4118-b77a-98dee0f21115"}, {"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-unplugged", "status": "completed", "tag": "d6c1ba60-17a7-41b4-85df-afed37da4170"}, {"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-plugged", "status": "completed", "tag": "d6c1ba60-17a7-41b4-85df-afed37da4170"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:37:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:34 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Creating event network-vif-plugged:74fde78e-82b3-43f3-9c87-2b754a4bd66f for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:37:34 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Creating event network-vif-unplugged:b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:37:34 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Creating event network-vif-plugged:b2b605c5-b5df-4936-8c3e-3ccfc1be9ad8 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:37:34 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Creating event network-vif-unplugged:b3872258-192d-4118-b77a-98dee0f21115 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:37:34 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Creating event network-vif-plugged:b3872258-192d-4118-b77a-98dee0f21115 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:37:34 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Creating event network-vif-unplugged:d6c1ba60-17a7-41b4-85df-afed37da4170 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:37:34 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] Creating event network-vif-plugged:d6c1ba60-17a7-41b4-85df-afed37da4170 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:37:34 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-77251515-ceb9-4dbb-b071-64f4423d2795 req-f9e4aded-bfd6-4a85-87a5-4d7f0b0e2a29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1215 microversion: 2.1 time: 0.044884 Apr 17 10:37:34 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 89/251] 10.0.0.210 () {68 vars in 1395 bytes} [Mon Apr 17 10:37:34 2023] POST /compute/v2.1/os-server-external-events => generated 1215 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:37:34 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-50759b9b-8a0e-44ef-b191-bb9f470a84a9 req-92f85008-b4b4-4884-a897-def2e4ec9902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-plugged", "status": "completed", "tag": "552d9aee-fdf7-4e99-8521-604486e3f888"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:37:34 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-50759b9b-8a0e-44ef-b191-bb9f470a84a9 req-92f85008-b4b4-4884-a897-def2e4ec9902 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:34 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-50759b9b-8a0e-44ef-b191-bb9f470a84a9 req-92f85008-b4b4-4884-a897-def2e4ec9902 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:34 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-50759b9b-8a0e-44ef-b191-bb9f470a84a9 req-92f85008-b4b4-4884-a897-def2e4ec9902 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:34 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-50759b9b-8a0e-44ef-b191-bb9f470a84a9 req-92f85008-b4b4-4884-a897-def2e4ec9902 service nova] Creating event network-vif-plugged:552d9aee-fdf7-4e99-8521-604486e3f888 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:37:34 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-50759b9b-8a0e-44ef-b191-bb9f470a84a9 req-92f85008-b4b4-4884-a897-def2e4ec9902 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036335 Apr 17 10:37:34 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 78/252] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:37:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:37:37 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-a8ad361a-4b4b-4b07-8d94-c41374555a2f req-2a778cc8-3a83-4060-8682-3c24583683e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-deleted", "tag": "c3988098-5dbd-47e1-896c-6a2b6415f64d"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:37:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-a8ad361a-4b4b-4b07-8d94-c41374555a2f req-2a778cc8-3a83-4060-8682-3c24583683e4 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-a8ad361a-4b4b-4b07-8d94-c41374555a2f req-2a778cc8-3a83-4060-8682-3c24583683e4 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-a8ad361a-4b4b-4b07-8d94-c41374555a2f req-2a778cc8-3a83-4060-8682-3c24583683e4 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:37 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-a8ad361a-4b4b-4b07-8d94-c41374555a2f req-2a778cc8-3a83-4060-8682-3c24583683e4 service nova] Creating event network-vif-deleted:c3988098-5dbd-47e1-896c-6a2b6415f64d for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:37:37 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-a8ad361a-4b4b-4b07-8d94-c41374555a2f req-2a778cc8-3a83-4060-8682-3c24583683e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045567 Apr 17 10:37:37 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 86/253] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:37:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:37:39 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-51cb5675-e659-4c34-b5b1-b574ef6bea1c req-c868926b-64f8-4b66-9100-44028f51e4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-deleted", "tag": "2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38"}, {"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-deleted", "tag": "d6c1ba60-17a7-41b4-85df-afed37da4170"}, {"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-deleted", "tag": "b3872258-192d-4118-b77a-98dee0f21115"}, {"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-deleted", "tag": "4ea57433-f4d1-4edf-ac36-c8099ce1cd8e"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:37:39 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-51cb5675-e659-4c34-b5b1-b574ef6bea1c req-c868926b-64f8-4b66-9100-44028f51e4d5 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:39 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-51cb5675-e659-4c34-b5b1-b574ef6bea1c req-c868926b-64f8-4b66-9100-44028f51e4d5 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:39 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-51cb5675-e659-4c34-b5b1-b574ef6bea1c req-c868926b-64f8-4b66-9100-44028f51e4d5 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:39 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-51cb5675-e659-4c34-b5b1-b574ef6bea1c req-c868926b-64f8-4b66-9100-44028f51e4d5 service nova] Creating event network-vif-deleted:2aeeb2c5-6b59-4f03-bec9-edd9c6ccac38 for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:37:39 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-51cb5675-e659-4c34-b5b1-b574ef6bea1c req-c868926b-64f8-4b66-9100-44028f51e4d5 service nova] Creating event network-vif-deleted:d6c1ba60-17a7-41b4-85df-afed37da4170 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:37:39 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-51cb5675-e659-4c34-b5b1-b574ef6bea1c req-c868926b-64f8-4b66-9100-44028f51e4d5 service nova] Creating event network-vif-deleted:b3872258-192d-4118-b77a-98dee0f21115 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:37:39 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-51cb5675-e659-4c34-b5b1-b574ef6bea1c req-c868926b-64f8-4b66-9100-44028f51e4d5 service nova] Creating event network-vif-deleted:4ea57433-f4d1-4edf-ac36-c8099ce1cd8e for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:37:39 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-51cb5675-e659-4c34-b5b1-b574ef6bea1c req-c868926b-64f8-4b66-9100-44028f51e4d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.040861 Apr 17 10:37:39 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 90/254] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:37:39 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:37:41 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-54398a33-fbe9-47ee-96e5-7dc5eed48cb1 req-66b20d21-66bc-4f73-afb4-278dced935ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-deleted", "tag": "552d9aee-fdf7-4e99-8521-604486e3f888"}, {"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-deleted", "tag": "0ea3a20e-3d8d-4cab-9783-0a22cab2e27b"}, {"server_uuid": "250f2cd2-b6ba-4a89-921f-cbd21ac36525", "name": "network-vif-deleted", "tag": "9df6de54-e8fe-425b-a344-de73c3cc5d3e"}, {"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-deleted", "tag": "acaf0b67-4938-4a01-ac74-86f0935046eb"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:37:41 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:37:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-54398a33-fbe9-47ee-96e5-7dc5eed48cb1 req-66b20d21-66bc-4f73-afb4-278dced935ba service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-54398a33-fbe9-47ee-96e5-7dc5eed48cb1 req-66b20d21-66bc-4f73-afb4-278dced935ba service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-54398a33-fbe9-47ee-96e5-7dc5eed48cb1 req-66b20d21-66bc-4f73-afb4-278dced935ba service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:41 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:37:41 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-54398a33-fbe9-47ee-96e5-7dc5eed48cb1 req-66b20d21-66bc-4f73-afb4-278dced935ba service nova] Creating event network-vif-deleted:552d9aee-fdf7-4e99-8521-604486e3f888 for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:37:41 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-54398a33-fbe9-47ee-96e5-7dc5eed48cb1 req-66b20d21-66bc-4f73-afb4-278dced935ba service nova] Creating event network-vif-deleted:0ea3a20e-3d8d-4cab-9783-0a22cab2e27b for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:37:41 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-54398a33-fbe9-47ee-96e5-7dc5eed48cb1 req-66b20d21-66bc-4f73-afb4-278dced935ba service nova] Creating event network-vif-deleted:9df6de54-e8fe-425b-a344-de73c3cc5d3e for instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 on user Apr 17 10:37:41 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-54398a33-fbe9-47ee-96e5-7dc5eed48cb1 req-66b20d21-66bc-4f73-afb4-278dced935ba service nova] Creating event network-vif-deleted:acaf0b67-4938-4a01-ac74-86f0935046eb for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:37:41 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-54398a33-fbe9-47ee-96e5-7dc5eed48cb1 req-66b20d21-66bc-4f73-afb4-278dced935ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.046836 Apr 17 10:37:41 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 79/255] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:37:41 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:37:42 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:42 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:42 user devstack@n-api.service[72743]: DEBUG nova.objects.instance [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lazy-loading 'services' on Instance uuid 7792cf72-dc73-4201-9501-4515ce860735 {{(pid=72743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 10:37:42 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-f337aaca-4f6c-4c6f-bc45-120f2b9d34ef tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments/9cb32346-a238-439d-8ae8-b87c782d41d4" status: 202 len: 0 microversion: 2.1 time: 0.255440 Apr 17 10:37:42 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 87/256] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Apr 17 10:37:42 2023] DELETE /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments/9cb32346-a238-439d-8ae8-b87c782d41d4 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:37:42 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-0329b532-9fd8-4cb3-b578-bfa54213417f tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:42 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-0329b532-9fd8-4cb3-b578-bfa54213417f tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0329b532-9fd8-4cb3-b578-bfa54213417f tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0329b532-9fd8-4cb3-b578-bfa54213417f tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0329b532-9fd8-4cb3-b578-bfa54213417f tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0329b532-9fd8-4cb3-b578-bfa54213417f tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0329b532-9fd8-4cb3-b578-bfa54213417f tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0329b532-9fd8-4cb3-b578-bfa54213417f tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:42 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-0329b532-9fd8-4cb3-b578-bfa54213417f tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050696 Apr 17 10:37:42 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 91/257] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:37:42 2023] GET /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:37:44 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-ed2ad4a4-73c2-48ca-869f-7d2dccc57481 req-98fc6640-0d17-4d2b-8353-33675be2fb87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f120f04-ecbf-496e-81c9-dcfed9084064", "name": "network-vif-deleted", "tag": "74fde78e-82b3-43f3-9c87-2b754a4bd66f"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:37:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-ed2ad4a4-73c2-48ca-869f-7d2dccc57481 req-98fc6640-0d17-4d2b-8353-33675be2fb87 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-ed2ad4a4-73c2-48ca-869f-7d2dccc57481 req-98fc6640-0d17-4d2b-8353-33675be2fb87 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-ed2ad4a4-73c2-48ca-869f-7d2dccc57481 req-98fc6640-0d17-4d2b-8353-33675be2fb87 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:44 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-ed2ad4a4-73c2-48ca-869f-7d2dccc57481 req-98fc6640-0d17-4d2b-8353-33675be2fb87 service nova] Creating event network-vif-deleted:74fde78e-82b3-43f3-9c87-2b754a4bd66f for instance 1f120f04-ecbf-496e-81c9-dcfed9084064 on user Apr 17 10:37:44 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-ed2ad4a4-73c2-48ca-869f-7d2dccc57481 req-98fc6640-0d17-4d2b-8353-33675be2fb87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044541 Apr 17 10:37:44 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 80/258] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:37:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 10:37:57 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:37:57 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:37:57 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-73a44cbd-6a19-4191-b216-ae681521ed58 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Action: 'create', calling method: .version_select at 0x7fc55ad94280>, body: {"keypair": {"name": "tempest-keypair-1227280417", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDSp1YCHo0WamouHfYqhd6t4hINXiuzX5js15gYMgufHxfeso8kqEAl2iSjtDfExNlw492ByGtbf5tE8z8aQ1XLRMfgbWfA15qujDz883cxYoe9taK+E1opthgdvxyldA=="}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:37:57 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-73a44cbd-6a19-4191-b216-ae681521ed58 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Getting quotas for project 507228fb562e461e91a628829ce32d80. Resources: {'key_pairs'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:37:57 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-73a44cbd-6a19-4191-b216-ae681521ed58 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Getting quotas for user ab512fbd85694415a5f7af8b689814d4 and project 507228fb562e461e91a628829ce32d80. Resources: {'key_pairs'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:37:57 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-73a44cbd-6a19-4191-b216-ae681521ed58 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.49 time: 0.054366 Apr 17 10:37:57 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 88/259] 10.0.0.210 () {66 vars in 1277 bytes} [Mon Apr 17 10:37:57 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 17 10:37:58 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1840654553", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "a4860ea0-3765-4c0e-a5dd-6f9f5268734a"}], "security_groups": [{"name": "tempest-securitygroup--774796212"}], "key_name": "tempest-keypair-1227280417", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:37:59 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=27 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:37:59 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=58,nova_cell1:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:37:59 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=3 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:37:59 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=3 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:37:59 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-1a85d659-ce21-4a0f-89ae-b9ef95518f55 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:59 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-1a85d659-ce21-4a0f-89ae-b9ef95518f55 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1a85d659-ce21-4a0f-89ae-b9ef95518f55 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1a85d659-ce21-4a0f-89ae-b9ef95518f55 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1a85d659-ce21-4a0f-89ae-b9ef95518f55 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1a85d659-ce21-4a0f-89ae-b9ef95518f55 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1a85d659-ce21-4a0f-89ae-b9ef95518f55 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1a85d659-ce21-4a0f-89ae-b9ef95518f55 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:59 user devstack@n-api.service[72745]: DEBUG nova.network.neutron [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] validate_networks() for [('a4860ea0-3765-4c0e-a5dd-6f9f5268734a', None, None, None, None, None)] {{(pid=72745) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:37:59 user devstack@n-api.service[72744]: INFO nova.api.openstack.wsgi [None req-1a85d659-ce21-4a0f-89ae-b9ef95518f55 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] HTTP exception thrown: Instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab could not be found. Apr 17 10:37:59 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-1a85d659-ce21-4a0f-89ae-b9ef95518f55 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Request method failure captured: Apr 17 10:37:59 user devstack@n-api.service[72744]: request: GET /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab HTTP/1.1 Apr 17 10:37:59 user devstack@n-api.service[72744]: Accept: application/json Apr 17 10:37:59 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 10:37:59 user devstack@n-api.service[72744]: Connection: close Apr 17 10:37:59 user devstack@n-api.service[72744]: Content-Length: 0 Apr 17 10:37:59 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 10:37:59 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 10:37:59 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 10:37:59 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 10:37:59 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSC3SCJSo3c1ZpqMwUhPorNuwXMZUEiYuY_NuD_28cSz4ls1Ca2JNOkNG7q4eBbh3e_GJBbDOByxMXq7ZbsHldx-ZC5rOr1COV88AMUZtvL9QiDQ1kc2FTEWeJOofmNfzaREoeWoi6i1NOSmv2o6TvPaUDZr4nqZJPKpOOUq3GKM75c Apr 17 10:37:59 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 10:37:59 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 10:37:59 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 10:37:59 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 10:37:59 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 10:37:59 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 10:37:59 user devstack@n-api.service[72744]: X-Project-Id: 50344f2e70ef48de8fbf64d408e61210 Apr 17 10:37:59 user devstack@n-api.service[72744]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1369167370 Apr 17 10:37:59 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 10:37:59 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 10:37:59 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/50344f2e70ef48de8fbf64d408e61210"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/50344f2e70ef48de8fbf64d408e61210"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/50344f2e70ef48de8fbf64d408e61210"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:37:59 user devstack@n-api.service[72744]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1369167370 Apr 17 10:37:59 user devstack@n-api.service[72744]: X-Tenant-Id: 50344f2e70ef48de8fbf64d408e61210 Apr 17 10:37:59 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1369167370 Apr 17 10:37:59 user devstack@n-api.service[72744]: X-User: tempest-AttachSCSIVolumeTestJSON-1369167370-project-member Apr 17 10:37:59 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 10:37:59 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 10:37:59 user devstack@n-api.service[72744]: X-User-Id: 1a9df3167c7947aab20f7c2ef837fe92 Apr 17 10:37:59 user devstack@n-api.service[72744]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1369167370-project-member Apr 17 10:37:59 user devstack@n-api.service[72744]: method: > Apr 17 10:37:59 user devstack@n-api.service[72744]: exception: Instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab could not be found. Apr 17 10:37:59 user devstack@n-api.service[72744]: action_args: {'id': '5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab'} Apr 17 10:37:59 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab could not be found. Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab could not be found. Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab could not be found. Apr 17 10:37:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:37:59 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-1a85d659-ce21-4a0f-89ae-b9ef95518f55 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Returning 404 to user: Instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab could not be found. {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:37:59 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-1a85d659-ce21-4a0f-89ae-b9ef95518f55 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" status: 404 len: 111 microversion: 2.1 time: 0.034791 Apr 17 10:37:59 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 81/260] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:37:59 2023] GET /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:37:59 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-263764fe-715c-4c4e-8685-d8bb950f698b tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Calling method '.version_select at 0x7fc55aa3b7f0>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:59 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-263764fe-715c-4c4e-8685-d8bb950f698b tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2120973316" status: 202 len: 0 microversion: 2.1 time: 0.028583 Apr 17 10:37:59 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 89/261] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Apr 17 10:37:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2120973316 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:37:59 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Flavor limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:37:59 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Image limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:37:59 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Flavor pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:37:59 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Image pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:37:59 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:37:59 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:59 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:59 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:59 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:37:59 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:37:59 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:37:59 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Getting quotas for project 507228fb562e461e91a628829ce32d80. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:37:59 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Getting quotas for user ab512fbd85694415a5f7af8b689814d4 and project 507228fb562e461e91a628829ce32d80. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:37:59 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Going to run 1 instances... {{(pid=72745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:37:59 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:37:59 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-a4c844f5-84ce-4981-b52b-d5da54b83686 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.49 time: 0.717473 Apr 17 10:37:59 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 92/262] 10.0.0.210 () {66 vars in 1265 bytes} [Mon Apr 17 10:37:58 2023] POST /compute/v2.1/servers => generated 403 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Apr 17 10:37:59 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-d38fe194-a7dd-48cf-88d8-5a5fda3403da tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:37:59 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-d38fe194-a7dd-48cf-88d8-5a5fda3403da tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:37:59 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-d38fe194-a7dd-48cf-88d8-5a5fda3403da tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab512fbd85694415a5f7af8b689814d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507228fb562e461e91a628829ce32d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:37:59 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-d38fe194-a7dd-48cf-88d8-5a5fda3403da tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab512fbd85694415a5f7af8b689814d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507228fb562e461e91a628829ce32d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:37:59 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-d38fe194-a7dd-48cf-88d8-5a5fda3403da tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab512fbd85694415a5f7af8b689814d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507228fb562e461e91a628829ce32d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:37:59 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-d38fe194-a7dd-48cf-88d8-5a5fda3403da tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" status: 200 len: 1321 microversion: 2.49 time: 0.073847 Apr 17 10:37:59 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 82/263] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:37:59 2023] GET /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 => generated 1321 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:38:02 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-f5e0059f-4231-489c-a168-27feb17fc58f req-4f1653b6-32eb-4d40-8368-f73048fa7b11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597", "tag": "3106e21d-664e-4c17-85be-f0a654c4eabc"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:02 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-f5e0059f-4231-489c-a168-27feb17fc58f req-4f1653b6-32eb-4d40-8368-f73048fa7b11 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:02 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-f5e0059f-4231-489c-a168-27feb17fc58f req-4f1653b6-32eb-4d40-8368-f73048fa7b11 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:02 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-f5e0059f-4231-489c-a168-27feb17fc58f req-4f1653b6-32eb-4d40-8368-f73048fa7b11 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:02 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-f5e0059f-4231-489c-a168-27feb17fc58f req-4f1653b6-32eb-4d40-8368-f73048fa7b11 service nova] Creating event network-changed:3106e21d-664e-4c17-85be-f0a654c4eabc for instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 on user Apr 17 10:38:02 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-f5e0059f-4231-489c-a168-27feb17fc58f req-4f1653b6-32eb-4d40-8368-f73048fa7b11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036695 Apr 17 10:38:02 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 90/264] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:38:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:38:03 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-2bcf32d4-29d9-4d6d-84c4-5e0857615030 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:38:03 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-2bcf32d4-29d9-4d6d-84c4-5e0857615030 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2bcf32d4-29d9-4d6d-84c4-5e0857615030 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2bcf32d4-29d9-4d6d-84c4-5e0857615030 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2bcf32d4-29d9-4d6d-84c4-5e0857615030 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2bcf32d4-29d9-4d6d-84c4-5e0857615030 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2bcf32d4-29d9-4d6d-84c4-5e0857615030 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2bcf32d4-29d9-4d6d-84c4-5e0857615030 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:03 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-2bcf32d4-29d9-4d6d-84c4-5e0857615030 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] HTTP exception thrown: Instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab could not be found. Apr 17 10:38:03 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-2bcf32d4-29d9-4d6d-84c4-5e0857615030 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Request method failure captured: Apr 17 10:38:03 user devstack@n-api.service[72745]: request: DELETE /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab HTTP/1.1 Apr 17 10:38:03 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:38:03 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:38:03 user devstack@n-api.service[72745]: Connection: close Apr 17 10:38:03 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 10:38:03 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:38:03 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:38:03 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:38:03 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:38:03 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSC3SCJSo3c1ZpqMwUhPorNuwXMZUEiYuY_NuD_28cSz4ls1Ca2JNOkNG7q4eBbh3e_GJBbDOByxMXq7ZbsHldx-ZC5rOr1COV88AMUZtvL9QiDQ1kc2FTEWeJOofmNfzaREoeWoi6i1NOSmv2o6TvPaUDZr4nqZJPKpOOUq3GKM75c Apr 17 10:38:03 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:38:03 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:38:03 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:38:03 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:38:03 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:38:03 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:38:03 user devstack@n-api.service[72745]: X-Project-Id: 50344f2e70ef48de8fbf64d408e61210 Apr 17 10:38:03 user devstack@n-api.service[72745]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1369167370 Apr 17 10:38:03 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:38:03 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:38:03 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/50344f2e70ef48de8fbf64d408e61210"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/50344f2e70ef48de8fbf64d408e61210"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/50344f2e70ef48de8fbf64d408e61210"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:38:03 user devstack@n-api.service[72745]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1369167370 Apr 17 10:38:03 user devstack@n-api.service[72745]: X-Tenant-Id: 50344f2e70ef48de8fbf64d408e61210 Apr 17 10:38:03 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1369167370 Apr 17 10:38:03 user devstack@n-api.service[72745]: X-User: tempest-AttachSCSIVolumeTestJSON-1369167370-project-member Apr 17 10:38:03 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:38:03 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:38:03 user devstack@n-api.service[72745]: X-User-Id: 1a9df3167c7947aab20f7c2ef837fe92 Apr 17 10:38:03 user devstack@n-api.service[72745]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1369167370-project-member Apr 17 10:38:03 user devstack@n-api.service[72745]: method: > Apr 17 10:38:03 user devstack@n-api.service[72745]: exception: Instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab could not be found. Apr 17 10:38:03 user devstack@n-api.service[72745]: action_args: {'id': '5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab'} Apr 17 10:38:03 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab could not be found. Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab could not be found. Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab could not be found. Apr 17 10:38:03 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:38:03 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-2bcf32d4-29d9-4d6d-84c4-5e0857615030 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Returning 404 to user: Instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:38:03 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-2bcf32d4-29d9-4d6d-84c4-5e0857615030 tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" status: 404 len: 111 microversion: 2.1 time: 0.039568 Apr 17 10:38:03 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 93/265] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:38:03 2023] DELETE /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:38:03 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-539da276-c253-4eda-96fc-a7182041d62e tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:38:03 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-539da276-c253-4eda-96fc-a7182041d62e tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] [instance: 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:03 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-539da276-c253-4eda-96fc-a7182041d62e tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:03 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-539da276-c253-4eda-96fc-a7182041d62e tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:03 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-539da276-c253-4eda-96fc-a7182041d62e tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:03 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-539da276-c253-4eda-96fc-a7182041d62e tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:03 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-539da276-c253-4eda-96fc-a7182041d62e tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:03 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-539da276-c253-4eda-96fc-a7182041d62e tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:03 user devstack@n-api.service[72744]: INFO nova.api.openstack.wsgi [None req-539da276-c253-4eda-96fc-a7182041d62e tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] HTTP exception thrown: Instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab could not be found. Apr 17 10:38:03 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-539da276-c253-4eda-96fc-a7182041d62e tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Request method failure captured: Apr 17 10:38:03 user devstack@n-api.service[72744]: request: GET /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab HTTP/1.1 Apr 17 10:38:03 user devstack@n-api.service[72744]: Accept: application/json Apr 17 10:38:03 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 10:38:03 user devstack@n-api.service[72744]: Connection: close Apr 17 10:38:03 user devstack@n-api.service[72744]: Content-Length: 0 Apr 17 10:38:03 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 10:38:03 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 10:38:03 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 10:38:03 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 10:38:03 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSC3SCJSo3c1ZpqMwUhPorNuwXMZUEiYuY_NuD_28cSz4ls1Ca2JNOkNG7q4eBbh3e_GJBbDOByxMXq7ZbsHldx-ZC5rOr1COV88AMUZtvL9QiDQ1kc2FTEWeJOofmNfzaREoeWoi6i1NOSmv2o6TvPaUDZr4nqZJPKpOOUq3GKM75c Apr 17 10:38:03 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 10:38:03 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 10:38:03 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 10:38:03 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 10:38:03 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 10:38:03 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 10:38:03 user devstack@n-api.service[72744]: X-Project-Id: 50344f2e70ef48de8fbf64d408e61210 Apr 17 10:38:03 user devstack@n-api.service[72744]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1369167370 Apr 17 10:38:03 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 10:38:03 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 10:38:03 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/50344f2e70ef48de8fbf64d408e61210"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/50344f2e70ef48de8fbf64d408e61210"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/50344f2e70ef48de8fbf64d408e61210"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:38:03 user devstack@n-api.service[72744]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1369167370 Apr 17 10:38:03 user devstack@n-api.service[72744]: X-Tenant-Id: 50344f2e70ef48de8fbf64d408e61210 Apr 17 10:38:03 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1369167370 Apr 17 10:38:03 user devstack@n-api.service[72744]: X-User: tempest-AttachSCSIVolumeTestJSON-1369167370-project-member Apr 17 10:38:03 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 10:38:03 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 10:38:03 user devstack@n-api.service[72744]: X-User-Id: 1a9df3167c7947aab20f7c2ef837fe92 Apr 17 10:38:03 user devstack@n-api.service[72744]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1369167370-project-member Apr 17 10:38:03 user devstack@n-api.service[72744]: method: > Apr 17 10:38:03 user devstack@n-api.service[72744]: exception: Instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab could not be found. Apr 17 10:38:03 user devstack@n-api.service[72744]: action_args: {'id': '5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab'} Apr 17 10:38:03 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab could not be found. Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab could not be found. Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab could not be found. Apr 17 10:38:03 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:38:03 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-539da276-c253-4eda-96fc-a7182041d62e tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] Returning 404 to user: Instance 5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab could not be found. {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:38:03 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-539da276-c253-4eda-96fc-a7182041d62e tempest-AttachSCSIVolumeTestJSON-1369167370 tempest-AttachSCSIVolumeTestJSON-1369167370-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab" status: 404 len: 111 microversion: 2.1 time: 0.031380 Apr 17 10:38:03 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 83/266] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:38:03 2023] GET /compute/v2.1/servers/5f9cb6d5-8595-4fa4-83b8-ff2c7e7552ab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:38:04 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-7df75982-e34a-4f4d-b5d6-e38f3bbeaf10 req-f9b04dde-737d-4946-87d4-113b018129e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597", "name": "network-vif-plugged", "status": "completed", "tag": "3106e21d-664e-4c17-85be-f0a654c4eabc"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-7df75982-e34a-4f4d-b5d6-e38f3bbeaf10 req-f9b04dde-737d-4946-87d4-113b018129e0 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-7df75982-e34a-4f4d-b5d6-e38f3bbeaf10 req-f9b04dde-737d-4946-87d4-113b018129e0 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-7df75982-e34a-4f4d-b5d6-e38f3bbeaf10 req-f9b04dde-737d-4946-87d4-113b018129e0 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:04 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-7df75982-e34a-4f4d-b5d6-e38f3bbeaf10 req-f9b04dde-737d-4946-87d4-113b018129e0 service nova] Creating event network-vif-plugged:3106e21d-664e-4c17-85be-f0a654c4eabc for instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 on user Apr 17 10:38:04 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-7df75982-e34a-4f4d-b5d6-e38f3bbeaf10 req-f9b04dde-737d-4946-87d4-113b018129e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031067 Apr 17 10:38:04 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 91/267] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:38:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:38:06 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-497a56e5-b2d1-40b4-9299-7bfad4d8544a req-a97f7bbf-91e6-4c79-9d89-030c3998397a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597", "name": "network-vif-plugged", "status": "completed", "tag": "3106e21d-664e-4c17-85be-f0a654c4eabc"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-497a56e5-b2d1-40b4-9299-7bfad4d8544a req-a97f7bbf-91e6-4c79-9d89-030c3998397a service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-497a56e5-b2d1-40b4-9299-7bfad4d8544a req-a97f7bbf-91e6-4c79-9d89-030c3998397a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-497a56e5-b2d1-40b4-9299-7bfad4d8544a req-a97f7bbf-91e6-4c79-9d89-030c3998397a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:06 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-497a56e5-b2d1-40b4-9299-7bfad4d8544a req-a97f7bbf-91e6-4c79-9d89-030c3998397a service nova] Creating event network-vif-plugged:3106e21d-664e-4c17-85be-f0a654c4eabc for instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 on user Apr 17 10:38:06 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-497a56e5-b2d1-40b4-9299-7bfad4d8544a req-a97f7bbf-91e6-4c79-9d89-030c3998397a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030850 Apr 17 10:38:06 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 94/268] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:38:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:38:14 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-c95cd89b-f544-4239-a84a-d13c89449299 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:38:14 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-c95cd89b-f544-4239-a84a-d13c89449299 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:14 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:38:14 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=8 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:38:14 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=4 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:38:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-c95cd89b-f544-4239-a84a-d13c89449299 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-c95cd89b-f544-4239-a84a-d13c89449299 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-c95cd89b-f544-4239-a84a-d13c89449299 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-c95cd89b-f544-4239-a84a-d13c89449299 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-c95cd89b-f544-4239-a84a-d13c89449299 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-c95cd89b-f544-4239-a84a-d13c89449299 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:14 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-c95cd89b-f544-4239-a84a-d13c89449299 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43c0aee7b05459d898e0dc2654262fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a793afb3e7045898c59a77975079d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:38:14 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-c95cd89b-f544-4239-a84a-d13c89449299 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0c707ac-b08f-4f18-8262-e1b79d7e17e1" status: 200 len: 1432 microversion: 2.1 time: 0.275079 Apr 17 10:38:14 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 84/269] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:38:14 2023] GET /compute/v2.1/servers/b0c707ac-b08f-4f18-8262-e1b79d7e17e1 => generated 1432 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:38:17 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=4 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:38:17 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:38:17 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=4 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:38:17 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1770450591", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "5678ceef-3151-4d42-9106-9996eafd66f1"}]}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:17 user devstack@n-api.service[72743]: DEBUG nova.network.neutron [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] validate_networks() for [('5678ceef-3151-4d42-9106-9996eafd66f1', None, None, None, None, None)] {{(pid=72743) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:38:17 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:38:17 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:38:17 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:38:17 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:38:17 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-cd21aca0-4a32-4908-a5e0-7d4e913d102a req-be9ea740-0777-4129-ac0d-2b7e940b23ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c707ac-b08f-4f18-8262-e1b79d7e17e1", "tag": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-cd21aca0-4a32-4908-a5e0-7d4e913d102a req-be9ea740-0777-4129-ac0d-2b7e940b23ec service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-cd21aca0-4a32-4908-a5e0-7d4e913d102a req-be9ea740-0777-4129-ac0d-2b7e940b23ec service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-cd21aca0-4a32-4908-a5e0-7d4e913d102a req-be9ea740-0777-4129-ac0d-2b7e940b23ec service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:17 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Flavor limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:38:17 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Image limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:38:17 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Flavor pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:38:17 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Image pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:38:17 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:38:17 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-cd21aca0-4a32-4908-a5e0-7d4e913d102a req-be9ea740-0777-4129-ac0d-2b7e940b23ec service nova] Creating event network-changed:90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 for instance b0c707ac-b08f-4f18-8262-e1b79d7e17e1 on user Apr 17 10:38:17 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:17 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:17 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:17 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-cd21aca0-4a32-4908-a5e0-7d4e913d102a req-be9ea740-0777-4129-ac0d-2b7e940b23ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058623 Apr 17 10:38:17 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:17 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 95/270] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:38:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:38:17 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:17 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:17 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Getting quotas for project faab4afa0ddf45578232627c2fac2ff8. Resources: {'cores', 'instances', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:38:17 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Getting quotas for user d8cb73d24d324903a625e4782270120e and project faab4afa0ddf45578232627c2fac2ff8. Resources: {'cores', 'instances', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:38:17 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Going to run 1 instances... {{(pid=72743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:38:17 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=72743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:38:17 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-6b20cd14-76c7-4a4b-a336-984636911158 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.988289 Apr 17 10:38:17 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 92/271] 10.0.0.210 () {66 vars in 1265 bytes} [Mon Apr 17 10:38:17 2023] POST /compute/v2.1/servers => generated 378 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 17 10:38:18 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-d4f1cd94-b577-43df-b7ff-892402330e2b tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:38:18 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-d4f1cd94-b577-43df-b7ff-892402330e2b tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:18 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:18 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:18 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:18 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:18 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:18 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:18 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:18 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:18 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-d4f1cd94-b577-43df-b7ff-892402330e2b tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:38:18 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-d4f1cd94-b577-43df-b7ff-892402330e2b tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:38:18 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-d4f1cd94-b577-43df-b7ff-892402330e2b tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:38:18 user devstack@n-api.service[72745]: DEBUG nova.objects.instance [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lazy-loading 'flavor' on Instance uuid b0c707ac-b08f-4f18-8262-e1b79d7e17e1 {{(pid=72745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 10:38:18 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-d4f1cd94-b577-43df-b7ff-892402330e2b tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" status: 200 len: 1395 microversion: 2.87 time: 0.197370 Apr 17 10:38:18 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 85/272] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:38:18 2023] GET /compute/v2.1/servers/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab => generated 1395 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:38:18 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-decbe9af-831d-436e-ae52-1fd11e9c0182 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b0c707ac-b08f-4f18-8262-e1b79d7e17e1/action" status: 202 len: 0 microversion: 2.1 time: 0.198548 Apr 17 10:38:18 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 96/273] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 10:38:18 2023] POST /compute/v2.1/servers/b0c707ac-b08f-4f18-8262-e1b79d7e17e1/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:38:18 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-48b153b3-1fab-46a0-9981-218b07469885 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:38:18 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-48b153b3-1fab-46a0-9981-218b07469885 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:18 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-48b153b3-1fab-46a0-9981-218b07469885 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:18 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-48b153b3-1fab-46a0-9981-218b07469885 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:18 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-48b153b3-1fab-46a0-9981-218b07469885 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:18 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-48b153b3-1fab-46a0-9981-218b07469885 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:18 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-48b153b3-1fab-46a0-9981-218b07469885 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:18 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-48b153b3-1fab-46a0-9981-218b07469885 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:18 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-48b153b3-1fab-46a0-9981-218b07469885 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43c0aee7b05459d898e0dc2654262fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a793afb3e7045898c59a77975079d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:38:18 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-48b153b3-1fab-46a0-9981-218b07469885 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0c707ac-b08f-4f18-8262-e1b79d7e17e1" status: 200 len: 1438 microversion: 2.1 time: 0.265302 Apr 17 10:38:18 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 93/274] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:38:18 2023] GET /compute/v2.1/servers/b0c707ac-b08f-4f18-8262-e1b79d7e17e1 => generated 1438 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:38:18 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-01056104-f6f9-4fd5-9546-a8cab7eb5261 req-f59bbc7c-45d0-48d4-8c6b-0d3783fb8686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c707ac-b08f-4f18-8262-e1b79d7e17e1", "name": "network-vif-unplugged", "status": "completed", "tag": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:18 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-01056104-f6f9-4fd5-9546-a8cab7eb5261 req-f59bbc7c-45d0-48d4-8c6b-0d3783fb8686 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:18 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-01056104-f6f9-4fd5-9546-a8cab7eb5261 req-f59bbc7c-45d0-48d4-8c6b-0d3783fb8686 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:18 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-01056104-f6f9-4fd5-9546-a8cab7eb5261 req-f59bbc7c-45d0-48d4-8c6b-0d3783fb8686 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:18 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-01056104-f6f9-4fd5-9546-a8cab7eb5261 req-f59bbc7c-45d0-48d4-8c6b-0d3783fb8686 service nova] Creating event network-vif-unplugged:90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 for instance b0c707ac-b08f-4f18-8262-e1b79d7e17e1 on user Apr 17 10:38:18 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-01056104-f6f9-4fd5-9546-a8cab7eb5261 req-f59bbc7c-45d0-48d4-8c6b-0d3783fb8686 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028949 Apr 17 10:38:18 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 86/275] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:38:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:38:19 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-5edb1afe-7892-44cc-9912-771104e139a4 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:38:19 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-5edb1afe-7892-44cc-9912-771104e139a4 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5edb1afe-7892-44cc-9912-771104e139a4 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5edb1afe-7892-44cc-9912-771104e139a4 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5edb1afe-7892-44cc-9912-771104e139a4 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5edb1afe-7892-44cc-9912-771104e139a4 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5edb1afe-7892-44cc-9912-771104e139a4 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5edb1afe-7892-44cc-9912-771104e139a4 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:19 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-5edb1afe-7892-44cc-9912-771104e139a4 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050859 Apr 17 10:38:19 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 97/276] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:38:19 2023] GET /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 17 10:38:19 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:38:19 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:19 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Going to try to terminate instance {{(pid=72743) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:38:19 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-d6e09b02-1e2d-4399-8e82-8f8627ec9e37 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" status: 204 len: 0 microversion: 2.1 time: 0.124908 Apr 17 10:38:19 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 94/277] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:38:19 2023] DELETE /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:38:19 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-ed70a082-feaf-46db-a437-3024b152cf36 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:38:19 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-ed70a082-feaf-46db-a437-3024b152cf36 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ed70a082-feaf-46db-a437-3024b152cf36 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ed70a082-feaf-46db-a437-3024b152cf36 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ed70a082-feaf-46db-a437-3024b152cf36 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ed70a082-feaf-46db-a437-3024b152cf36 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ed70a082-feaf-46db-a437-3024b152cf36 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ed70a082-feaf-46db-a437-3024b152cf36 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:19 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-d7c023d3-f3a7-4266-90a0-f5595cf583ad req-f8208224-5fa0-45dc-ad01-b85dfed3cb93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d", "name": "network-vif-unplugged", "status": "completed", "tag": "01527ff5-7a84-4bbf-ae89-ef334a97fc0a"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:19 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-5909dde8-7306-4026-8b7d-e2c127c886ca tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:38:19 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-5909dde8-7306-4026-8b7d-e2c127c886ca tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5909dde8-7306-4026-8b7d-e2c127c886ca tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5909dde8-7306-4026-8b7d-e2c127c886ca tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5909dde8-7306-4026-8b7d-e2c127c886ca tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5909dde8-7306-4026-8b7d-e2c127c886ca tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5909dde8-7306-4026-8b7d-e2c127c886ca tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5909dde8-7306-4026-8b7d-e2c127c886ca tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-d7c023d3-f3a7-4266-90a0-f5595cf583ad req-f8208224-5fa0-45dc-ad01-b85dfed3cb93 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-d7c023d3-f3a7-4266-90a0-f5595cf583ad req-f8208224-5fa0-45dc-ad01-b85dfed3cb93 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-d7c023d3-f3a7-4266-90a0-f5595cf583ad req-f8208224-5fa0-45dc-ad01-b85dfed3cb93 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:19 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-5909dde8-7306-4026-8b7d-e2c127c886ca tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] HTTP exception thrown: Instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 could not be found. Apr 17 10:38:19 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-5909dde8-7306-4026-8b7d-e2c127c886ca tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Request method failure captured: Apr 17 10:38:19 user devstack@n-api.service[72743]: request: GET /compute/v2.1/servers/250f2cd2-b6ba-4a89-921f-cbd21ac36525 HTTP/1.1 Apr 17 10:38:19 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:38:19 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:38:19 user devstack@n-api.service[72743]: Connection: close Apr 17 10:38:19 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:38:19 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:38:19 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:38:19 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:38:19 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:38:19 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSCrf2Tk_r45VxlkmxzxIwOJe7SmYdH-FBgBkG4NuEw6AZ6Ki2cp2K5CU_k1vaCsNBRULeEnfjlUh_qinsotKmZ9LzjywBAdz4ol0y2qHnfepOyTw0PEGIFIZRbLfQI8d7Hg0ZgYDdG-iyBdsmcB-JusKeilAF7UDYMjnMGlSn9nFwE Apr 17 10:38:19 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:38:19 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:38:19 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:38:19 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:38:19 user devstack@n-api.service[72743]: X-Openstack-Nova-Api-Version: 2.32 Apr 17 10:38:19 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:38:19 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:38:19 user devstack@n-api.service[72743]: X-Project-Id: a553d324884a4e5785c896d76b2a9376 Apr 17 10:38:19 user devstack@n-api.service[72743]: X-Project-Name: tempest-TaggedBootDevicesTest-615877170 Apr 17 10:38:19 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:38:19 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:38:19 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a553d324884a4e5785c896d76b2a9376"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a553d324884a4e5785c896d76b2a9376"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a553d324884a4e5785c896d76b2a9376"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:38:19 user devstack@n-api.service[72743]: X-Tenant: tempest-TaggedBootDevicesTest-615877170 Apr 17 10:38:19 user devstack@n-api.service[72743]: X-Tenant-Id: a553d324884a4e5785c896d76b2a9376 Apr 17 10:38:19 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-TaggedBootDevicesTest-615877170 Apr 17 10:38:19 user devstack@n-api.service[72743]: X-User: tempest-TaggedBootDevicesTest-615877170-project-member Apr 17 10:38:19 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:38:19 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:38:19 user devstack@n-api.service[72743]: X-User-Id: 41eaa1a7dc224ec4bd8ebd5fdef1fbeb Apr 17 10:38:19 user devstack@n-api.service[72743]: X-User-Name: tempest-TaggedBootDevicesTest-615877170-project-member Apr 17 10:38:19 user devstack@n-api.service[72743]: method: > Apr 17 10:38:19 user devstack@n-api.service[72743]: exception: Instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 could not be found. Apr 17 10:38:19 user devstack@n-api.service[72743]: action_args: {'id': '250f2cd2-b6ba-4a89-921f-cbd21ac36525'} Apr 17 10:38:19 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 could not be found. Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 could not be found. Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 could not be found. Apr 17 10:38:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:38:19 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-5909dde8-7306-4026-8b7d-e2c127c886ca tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Returning 404 to user: Instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:38:19 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-5909dde8-7306-4026-8b7d-e2c127c886ca tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] 10.0.0.210 "GET /compute/v2.1/servers/250f2cd2-b6ba-4a89-921f-cbd21ac36525" status: 404 len: 111 microversion: 2.32 time: 0.029651 Apr 17 10:38:19 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 95/278] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:38:19 2023] GET /compute/v2.1/servers/250f2cd2-b6ba-4a89-921f-cbd21ac36525 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 10:38:19 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-d7c023d3-f3a7-4266-90a0-f5595cf583ad req-f8208224-5fa0-45dc-ad01-b85dfed3cb93 service nova] Creating event network-vif-unplugged:01527ff5-7a84-4bbf-ae89-ef334a97fc0a for instance 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d on user Apr 17 10:38:19 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-c998b7f2-6280-4824-bc46-1579cfd841ed tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Calling method '.version_select at 0x7fc55aa3add0>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:38:19 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-d7c023d3-f3a7-4266-90a0-f5595cf583ad req-f8208224-5fa0-45dc-ad01-b85dfed3cb93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051384 Apr 17 10:38:19 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 98/279] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:38:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:38:19 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-c998b7f2-6280-4824-bc46-1579cfd841ed tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090401125" status: 204 len: 0 microversion: 2.32 time: 0.022488 Apr 17 10:38:19 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 96/280] 10.0.0.210 () {64 vars in 1339 bytes} [Mon Apr 17 10:38:19 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090401125 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 17 10:38:20 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-ed70a082-feaf-46db-a437-3024b152cf36 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c3804bb0449c8bba3b56df41ccc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ad2dd86dc14ead939b4fdca5a97a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:38:20 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-ed70a082-feaf-46db-a437-3024b152cf36 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" status: 200 len: 1647 microversion: 2.1 time: 0.992883 Apr 17 10:38:20 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 87/281] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:38:19 2023] GET /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d => generated 1647 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:38:20 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-505dedf3-2331-4276-985a-cf753908427f req-a2888795-e8bf-4821-9587-f8e6e0360443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c707ac-b08f-4f18-8262-e1b79d7e17e1", "name": "network-vif-plugged", "status": "completed", "tag": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:20 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-505dedf3-2331-4276-985a-cf753908427f req-a2888795-e8bf-4821-9587-f8e6e0360443 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:20 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-505dedf3-2331-4276-985a-cf753908427f req-a2888795-e8bf-4821-9587-f8e6e0360443 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:20 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-505dedf3-2331-4276-985a-cf753908427f req-a2888795-e8bf-4821-9587-f8e6e0360443 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:20 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-505dedf3-2331-4276-985a-cf753908427f req-a2888795-e8bf-4821-9587-f8e6e0360443 service nova] Creating event network-vif-plugged:90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 for instance b0c707ac-b08f-4f18-8262-e1b79d7e17e1 on user Apr 17 10:38:20 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-505dedf3-2331-4276-985a-cf753908427f req-a2888795-e8bf-4821-9587-f8e6e0360443 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032594 Apr 17 10:38:20 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 99/282] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:38:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:38:21 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b814a8be-800b-4554-ac8d-998ae0178371 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:38:21 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-b814a8be-800b-4554-ac8d-998ae0178371 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b814a8be-800b-4554-ac8d-998ae0178371 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b814a8be-800b-4554-ac8d-998ae0178371 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b814a8be-800b-4554-ac8d-998ae0178371 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b814a8be-800b-4554-ac8d-998ae0178371 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b814a8be-800b-4554-ac8d-998ae0178371 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b814a8be-800b-4554-ac8d-998ae0178371 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:21 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-b814a8be-800b-4554-ac8d-998ae0178371 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] HTTP exception thrown: Instance 1f120f04-ecbf-496e-81c9-dcfed9084064 could not be found. Apr 17 10:38:21 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b814a8be-800b-4554-ac8d-998ae0178371 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Request method failure captured: Apr 17 10:38:21 user devstack@n-api.service[72743]: request: GET /compute/v2.1/servers/1f120f04-ecbf-496e-81c9-dcfed9084064 HTTP/1.1 Apr 17 10:38:21 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:38:21 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:38:21 user devstack@n-api.service[72743]: Connection: close Apr 17 10:38:21 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:38:21 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:38:21 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:38:21 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:38:21 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:38:21 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSC49kG1pAymssIyIM9wMZeZgz1SAHc9PvR7GVI8sC_4_FTUdukMXNhNcC9ZTE2tjytT7Dy8CkSIMEo_NTfpDp8tva_lHnO1NnJwjaijxfo0GAKxlMR_Doi__XFBNUDIBdFZOSy3nEgzS1inrzbPce4P8lxESv9K4_L1UDkBVwE5Hoc Apr 17 10:38:21 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:38:21 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:38:21 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:38:21 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:38:21 user devstack@n-api.service[72743]: X-Openstack-Nova-Api-Version: 2.42 Apr 17 10:38:21 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:38:21 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:38:21 user devstack@n-api.service[72743]: X-Project-Id: c5c3233510fa4ef1bb876bd6ee37a443 Apr 17 10:38:21 user devstack@n-api.service[72743]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-99130841 Apr 17 10:38:21 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:38:21 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:38:21 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5c3233510fa4ef1bb876bd6ee37a443"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5c3233510fa4ef1bb876bd6ee37a443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c5c3233510fa4ef1bb876bd6ee37a443"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:38:21 user devstack@n-api.service[72743]: X-Tenant: tempest-TaggedBootDevicesTest_v242-99130841 Apr 17 10:38:21 user devstack@n-api.service[72743]: X-Tenant-Id: c5c3233510fa4ef1bb876bd6ee37a443 Apr 17 10:38:21 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-99130841 Apr 17 10:38:21 user devstack@n-api.service[72743]: X-User: tempest-TaggedBootDevicesTest_v242-99130841-project-member Apr 17 10:38:21 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:38:21 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:38:21 user devstack@n-api.service[72743]: X-User-Id: 245581ebc4824aa7addd4d4272d4a47d Apr 17 10:38:21 user devstack@n-api.service[72743]: X-User-Name: tempest-TaggedBootDevicesTest_v242-99130841-project-member Apr 17 10:38:21 user devstack@n-api.service[72743]: method: > Apr 17 10:38:21 user devstack@n-api.service[72743]: exception: Instance 1f120f04-ecbf-496e-81c9-dcfed9084064 could not be found. Apr 17 10:38:21 user devstack@n-api.service[72743]: action_args: {'id': '1f120f04-ecbf-496e-81c9-dcfed9084064'} Apr 17 10:38:21 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f120f04-ecbf-496e-81c9-dcfed9084064 could not be found. Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f120f04-ecbf-496e-81c9-dcfed9084064 could not be found. Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f120f04-ecbf-496e-81c9-dcfed9084064 could not be found. Apr 17 10:38:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:38:21 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b814a8be-800b-4554-ac8d-998ae0178371 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Returning 404 to user: Instance 1f120f04-ecbf-496e-81c9-dcfed9084064 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:38:21 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-b814a8be-800b-4554-ac8d-998ae0178371 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f120f04-ecbf-496e-81c9-dcfed9084064" status: 404 len: 111 microversion: 2.42 time: 0.031289 Apr 17 10:38:21 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 97/283] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:38:21 2023] GET /compute/v2.1/servers/1f120f04-ecbf-496e-81c9-dcfed9084064 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 10:38:21 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-86fb5cfe-fe02-436f-ac04-95a4e2d61fb2 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Calling method '.version_select at 0x7fc55a976170>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:38:21 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-86fb5cfe-fe02-436f-ac04-95a4e2d61fb2 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1616755361" status: 204 len: 0 microversion: 2.42 time: 0.022967 Apr 17 10:38:21 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 88/284] 10.0.0.210 () {64 vars in 1339 bytes} [Mon Apr 17 10:38:21 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1616755361 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 17 10:38:21 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-f14066af-5487-4b69-9921-acf1d78d5aa4 req-19ef45e3-7c28-498a-95bb-7c6efeb8f313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c707ac-b08f-4f18-8262-e1b79d7e17e1", "tag": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:21 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-f14066af-5487-4b69-9921-acf1d78d5aa4 req-19ef45e3-7c28-498a-95bb-7c6efeb8f313 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:21 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-f14066af-5487-4b69-9921-acf1d78d5aa4 req-19ef45e3-7c28-498a-95bb-7c6efeb8f313 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:21 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-f14066af-5487-4b69-9921-acf1d78d5aa4 req-19ef45e3-7c28-498a-95bb-7c6efeb8f313 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:21 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-f14066af-5487-4b69-9921-acf1d78d5aa4 req-19ef45e3-7c28-498a-95bb-7c6efeb8f313 service nova] Creating event network-changed:90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 for instance b0c707ac-b08f-4f18-8262-e1b79d7e17e1 on user Apr 17 10:38:21 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-f14066af-5487-4b69-9921-acf1d78d5aa4 req-19ef45e3-7c28-498a-95bb-7c6efeb8f313 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032123 Apr 17 10:38:21 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 100/285] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:38:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:38:21 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-a422e0de-203d-4512-a68c-74f2f85282fa req-82dee15e-754a-42e4-acce-6f24d1651c6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d", "name": "network-vif-plugged", "status": "completed", "tag": "01527ff5-7a84-4bbf-ae89-ef334a97fc0a"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-a422e0de-203d-4512-a68c-74f2f85282fa req-82dee15e-754a-42e4-acce-6f24d1651c6f service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-a422e0de-203d-4512-a68c-74f2f85282fa req-82dee15e-754a-42e4-acce-6f24d1651c6f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-a422e0de-203d-4512-a68c-74f2f85282fa req-82dee15e-754a-42e4-acce-6f24d1651c6f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:21 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-a422e0de-203d-4512-a68c-74f2f85282fa req-82dee15e-754a-42e4-acce-6f24d1651c6f service nova] Creating event network-vif-plugged:01527ff5-7a84-4bbf-ae89-ef334a97fc0a for instance 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d on user Apr 17 10:38:21 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-a422e0de-203d-4512-a68c-74f2f85282fa req-82dee15e-754a-42e4-acce-6f24d1651c6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036802 Apr 17 10:38:21 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 98/286] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:38:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:38:22 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-e2628732-6716-45d8-b72e-ed6d505d1dd0 req-0c37e0da-e331-4b4c-b636-cc9eaaf17659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3336cde8-eedb-4d3e-8c20-b79cd2d1f51d", "name": "network-vif-deleted", "tag": "01527ff5-7a84-4bbf-ae89-ef334a97fc0a"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:22 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-e2628732-6716-45d8-b72e-ed6d505d1dd0 req-0c37e0da-e331-4b4c-b636-cc9eaaf17659 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:22 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-e2628732-6716-45d8-b72e-ed6d505d1dd0 req-0c37e0da-e331-4b4c-b636-cc9eaaf17659 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:22 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-e2628732-6716-45d8-b72e-ed6d505d1dd0 req-0c37e0da-e331-4b4c-b636-cc9eaaf17659 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:22 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-e2628732-6716-45d8-b72e-ed6d505d1dd0 req-0c37e0da-e331-4b4c-b636-cc9eaaf17659 service nova] Creating event network-vif-deleted:01527ff5-7a84-4bbf-ae89-ef334a97fc0a for instance 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d on user Apr 17 10:38:22 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-e2628732-6716-45d8-b72e-ed6d505d1dd0 req-0c37e0da-e331-4b4c-b636-cc9eaaf17659 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042163 Apr 17 10:38:22 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 89/287] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:38:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:38:23 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-2b4d845a-d114-43e5-b8cd-676eb92b8abd req-b7b7b460-b03e-4a47-a215-9f224e7eda88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab", "tag": "2acfe658-2dce-4086-b24a-ef0b4c3714f8"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-2b4d845a-d114-43e5-b8cd-676eb92b8abd req-b7b7b460-b03e-4a47-a215-9f224e7eda88 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-2b4d845a-d114-43e5-b8cd-676eb92b8abd req-b7b7b460-b03e-4a47-a215-9f224e7eda88 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-2b4d845a-d114-43e5-b8cd-676eb92b8abd req-b7b7b460-b03e-4a47-a215-9f224e7eda88 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:23 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-2b4d845a-d114-43e5-b8cd-676eb92b8abd req-b7b7b460-b03e-4a47-a215-9f224e7eda88 service nova] Creating event network-changed:2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab on user Apr 17 10:38:23 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-2b4d845a-d114-43e5-b8cd-676eb92b8abd req-b7b7b460-b03e-4a47-a215-9f224e7eda88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039083 Apr 17 10:38:23 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 101/288] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:38:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:38:26 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-f729ca46-c709-41ba-b94d-01a3cba9e146 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:38:26 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-f729ca46-c709-41ba-b94d-01a3cba9e146 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f729ca46-c709-41ba-b94d-01a3cba9e146 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f729ca46-c709-41ba-b94d-01a3cba9e146 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f729ca46-c709-41ba-b94d-01a3cba9e146 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f729ca46-c709-41ba-b94d-01a3cba9e146 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f729ca46-c709-41ba-b94d-01a3cba9e146 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f729ca46-c709-41ba-b94d-01a3cba9e146 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:26 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-f729ca46-c709-41ba-b94d-01a3cba9e146 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] HTTP exception thrown: Instance 1f120f04-ecbf-496e-81c9-dcfed9084064 could not be found. Apr 17 10:38:26 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-f729ca46-c709-41ba-b94d-01a3cba9e146 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Request method failure captured: Apr 17 10:38:26 user devstack@n-api.service[72743]: request: DELETE /compute/v2.1/servers/1f120f04-ecbf-496e-81c9-dcfed9084064 HTTP/1.1 Apr 17 10:38:26 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:38:26 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:38:26 user devstack@n-api.service[72743]: Connection: close Apr 17 10:38:26 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:38:26 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:38:26 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:38:26 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:38:26 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:38:26 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSC49kG1pAymssIyIM9wMZeZgz1SAHc9PvR7GVI8sC_4_FTUdukMXNhNcC9ZTE2tjytT7Dy8CkSIMEo_NTfpDp8tva_lHnO1NnJwjaijxfo0GAKxlMR_Doi__XFBNUDIBdFZOSy3nEgzS1inrzbPce4P8lxESv9K4_L1UDkBVwE5Hoc Apr 17 10:38:26 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:38:26 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:38:26 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:38:26 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:38:26 user devstack@n-api.service[72743]: X-Openstack-Nova-Api-Version: 2.42 Apr 17 10:38:26 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:38:26 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:38:26 user devstack@n-api.service[72743]: X-Project-Id: c5c3233510fa4ef1bb876bd6ee37a443 Apr 17 10:38:26 user devstack@n-api.service[72743]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-99130841 Apr 17 10:38:26 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:38:26 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:38:26 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5c3233510fa4ef1bb876bd6ee37a443"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5c3233510fa4ef1bb876bd6ee37a443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c5c3233510fa4ef1bb876bd6ee37a443"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:38:26 user devstack@n-api.service[72743]: X-Tenant: tempest-TaggedBootDevicesTest_v242-99130841 Apr 17 10:38:26 user devstack@n-api.service[72743]: X-Tenant-Id: c5c3233510fa4ef1bb876bd6ee37a443 Apr 17 10:38:26 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-99130841 Apr 17 10:38:26 user devstack@n-api.service[72743]: X-User: tempest-TaggedBootDevicesTest_v242-99130841-project-member Apr 17 10:38:26 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:38:26 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:38:26 user devstack@n-api.service[72743]: X-User-Id: 245581ebc4824aa7addd4d4272d4a47d Apr 17 10:38:26 user devstack@n-api.service[72743]: X-User-Name: tempest-TaggedBootDevicesTest_v242-99130841-project-member Apr 17 10:38:26 user devstack@n-api.service[72743]: method: > Apr 17 10:38:26 user devstack@n-api.service[72743]: exception: Instance 1f120f04-ecbf-496e-81c9-dcfed9084064 could not be found. Apr 17 10:38:26 user devstack@n-api.service[72743]: action_args: {'id': '1f120f04-ecbf-496e-81c9-dcfed9084064'} Apr 17 10:38:26 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f120f04-ecbf-496e-81c9-dcfed9084064 could not be found. Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f120f04-ecbf-496e-81c9-dcfed9084064 could not be found. Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f120f04-ecbf-496e-81c9-dcfed9084064 could not be found. Apr 17 10:38:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:38:26 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-f729ca46-c709-41ba-b94d-01a3cba9e146 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Returning 404 to user: Instance 1f120f04-ecbf-496e-81c9-dcfed9084064 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:38:26 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-f729ca46-c709-41ba-b94d-01a3cba9e146 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1f120f04-ecbf-496e-81c9-dcfed9084064" status: 404 len: 111 microversion: 2.42 time: 0.033287 Apr 17 10:38:26 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 99/289] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 17 10:38:26 2023] DELETE /compute/v2.1/servers/1f120f04-ecbf-496e-81c9-dcfed9084064 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 10:38:26 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-01559799-0be4-4177-aa61-9885878ea228 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:38:26 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-01559799-0be4-4177-aa61-9885878ea228 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] [instance: 1f120f04-ecbf-496e-81c9-dcfed9084064] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-01559799-0be4-4177-aa61-9885878ea228 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-01559799-0be4-4177-aa61-9885878ea228 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-01559799-0be4-4177-aa61-9885878ea228 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-01559799-0be4-4177-aa61-9885878ea228 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-01559799-0be4-4177-aa61-9885878ea228 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-01559799-0be4-4177-aa61-9885878ea228 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:26 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-0b8fda31-ec20-4135-9b7b-2bf1879ad201 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e959d4f-1d94-402d-84d5-323e6a987d67"}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:26 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-0b8fda31-ec20-4135-9b7b-2bf1879ad201 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0b8fda31-ec20-4135-9b7b-2bf1879ad201 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0b8fda31-ec20-4135-9b7b-2bf1879ad201 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0b8fda31-ec20-4135-9b7b-2bf1879ad201 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0b8fda31-ec20-4135-9b7b-2bf1879ad201 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0b8fda31-ec20-4135-9b7b-2bf1879ad201 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0b8fda31-ec20-4135-9b7b-2bf1879ad201 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:26 user devstack@n-api.service[72744]: INFO nova.api.openstack.wsgi [None req-01559799-0be4-4177-aa61-9885878ea228 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] HTTP exception thrown: Instance 1f120f04-ecbf-496e-81c9-dcfed9084064 could not be found. Apr 17 10:38:26 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-01559799-0be4-4177-aa61-9885878ea228 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Request method failure captured: Apr 17 10:38:26 user devstack@n-api.service[72744]: request: GET /compute/v2.1/servers/1f120f04-ecbf-496e-81c9-dcfed9084064 HTTP/1.1 Apr 17 10:38:26 user devstack@n-api.service[72744]: Accept: application/json Apr 17 10:38:26 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 10:38:26 user devstack@n-api.service[72744]: Connection: close Apr 17 10:38:26 user devstack@n-api.service[72744]: Content-Length: 0 Apr 17 10:38:26 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 10:38:26 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 10:38:26 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 10:38:26 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 10:38:26 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSC49kG1pAymssIyIM9wMZeZgz1SAHc9PvR7GVI8sC_4_FTUdukMXNhNcC9ZTE2tjytT7Dy8CkSIMEo_NTfpDp8tva_lHnO1NnJwjaijxfo0GAKxlMR_Doi__XFBNUDIBdFZOSy3nEgzS1inrzbPce4P8lxESv9K4_L1UDkBVwE5Hoc Apr 17 10:38:26 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 10:38:26 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 10:38:26 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 10:38:26 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 10:38:26 user devstack@n-api.service[72744]: X-Openstack-Nova-Api-Version: 2.42 Apr 17 10:38:26 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 10:38:26 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 10:38:26 user devstack@n-api.service[72744]: X-Project-Id: c5c3233510fa4ef1bb876bd6ee37a443 Apr 17 10:38:26 user devstack@n-api.service[72744]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-99130841 Apr 17 10:38:26 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 10:38:26 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 10:38:26 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5c3233510fa4ef1bb876bd6ee37a443"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c5c3233510fa4ef1bb876bd6ee37a443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c5c3233510fa4ef1bb876bd6ee37a443"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:38:26 user devstack@n-api.service[72744]: X-Tenant: tempest-TaggedBootDevicesTest_v242-99130841 Apr 17 10:38:26 user devstack@n-api.service[72744]: X-Tenant-Id: c5c3233510fa4ef1bb876bd6ee37a443 Apr 17 10:38:26 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-99130841 Apr 17 10:38:26 user devstack@n-api.service[72744]: X-User: tempest-TaggedBootDevicesTest_v242-99130841-project-member Apr 17 10:38:26 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 10:38:26 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 10:38:26 user devstack@n-api.service[72744]: X-User-Id: 245581ebc4824aa7addd4d4272d4a47d Apr 17 10:38:26 user devstack@n-api.service[72744]: X-User-Name: tempest-TaggedBootDevicesTest_v242-99130841-project-member Apr 17 10:38:26 user devstack@n-api.service[72744]: method: > Apr 17 10:38:26 user devstack@n-api.service[72744]: exception: Instance 1f120f04-ecbf-496e-81c9-dcfed9084064 could not be found. Apr 17 10:38:26 user devstack@n-api.service[72744]: action_args: {'id': '1f120f04-ecbf-496e-81c9-dcfed9084064'} Apr 17 10:38:26 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f120f04-ecbf-496e-81c9-dcfed9084064 could not be found. Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f120f04-ecbf-496e-81c9-dcfed9084064 could not be found. Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f120f04-ecbf-496e-81c9-dcfed9084064 could not be found. Apr 17 10:38:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:38:26 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-01559799-0be4-4177-aa61-9885878ea228 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] Returning 404 to user: Instance 1f120f04-ecbf-496e-81c9-dcfed9084064 could not be found. {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:38:26 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-01559799-0be4-4177-aa61-9885878ea228 tempest-TaggedBootDevicesTest_v242-99130841 tempest-TaggedBootDevicesTest_v242-99130841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f120f04-ecbf-496e-81c9-dcfed9084064" status: 404 len: 111 microversion: 2.42 time: 0.029761 Apr 17 10:38:26 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 90/290] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:38:26 2023] GET /compute/v2.1/servers/1f120f04-ecbf-496e-81c9-dcfed9084064 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 10:38:26 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-0b8fda31-ec20-4135-9b7b-2bf1879ad201 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.395820 Apr 17 10:38:26 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 102/291] 10.0.0.210 () {66 vars in 1441 bytes} [Mon Apr 17 10:38:26 2023] POST /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d/os-volume_attachments => generated 188 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 10:38:26 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:26 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:26 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=72743) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 17 10:38:26 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-c1b086df-5004-42ee-908f-2b9fcb09936e tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d/action" status: 202 len: 0 microversion: 2.20 time: 0.136690 Apr 17 10:38:26 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 100/292] 10.0.0.210 () {66 vars in 1396 bytes} [Mon Apr 17 10:38:26 2023] POST /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:38:26 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-27d18ec5-0097-435c-8392-240175fd5592 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:38:26 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-27d18ec5-0097-435c-8392-240175fd5592 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-27d18ec5-0097-435c-8392-240175fd5592 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-27d18ec5-0097-435c-8392-240175fd5592 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-27d18ec5-0097-435c-8392-240175fd5592 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-27d18ec5-0097-435c-8392-240175fd5592 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-27d18ec5-0097-435c-8392-240175fd5592 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-27d18ec5-0097-435c-8392-240175fd5592 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:27 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-d877bd5e-0284-4d74-bcef-c3e52a7a1979 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:38:27 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-d877bd5e-0284-4d74-bcef-c3e52a7a1979 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d877bd5e-0284-4d74-bcef-c3e52a7a1979 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d877bd5e-0284-4d74-bcef-c3e52a7a1979 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d877bd5e-0284-4d74-bcef-c3e52a7a1979 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d877bd5e-0284-4d74-bcef-c3e52a7a1979 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d877bd5e-0284-4d74-bcef-c3e52a7a1979 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d877bd5e-0284-4d74-bcef-c3e52a7a1979 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:27 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-d877bd5e-0284-4d74-bcef-c3e52a7a1979 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] HTTP exception thrown: Instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 could not be found. Apr 17 10:38:27 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-d877bd5e-0284-4d74-bcef-c3e52a7a1979 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Request method failure captured: Apr 17 10:38:27 user devstack@n-api.service[72745]: request: DELETE /compute/v2.1/servers/250f2cd2-b6ba-4a89-921f-cbd21ac36525 HTTP/1.1 Apr 17 10:38:27 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:38:27 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:38:27 user devstack@n-api.service[72745]: Connection: close Apr 17 10:38:27 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 10:38:27 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:38:27 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:38:27 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:38:27 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:38:27 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSCrf2Tk_r45VxlkmxzxIwOJe7SmYdH-FBgBkG4NuEw6AZ6Ki2cp2K5CU_k1vaCsNBRULeEnfjlUh_qinsotKmZ9LzjywBAdz4ol0y2qHnfepOyTw0PEGIFIZRbLfQI8d7Hg0ZgYDdG-iyBdsmcB-JusKeilAF7UDYMjnMGlSn9nFwE Apr 17 10:38:27 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:38:27 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:38:27 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:38:27 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:38:27 user devstack@n-api.service[72745]: X-Openstack-Nova-Api-Version: 2.32 Apr 17 10:38:27 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:38:27 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:38:27 user devstack@n-api.service[72745]: X-Project-Id: a553d324884a4e5785c896d76b2a9376 Apr 17 10:38:27 user devstack@n-api.service[72745]: X-Project-Name: tempest-TaggedBootDevicesTest-615877170 Apr 17 10:38:27 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:38:27 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:38:27 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a553d324884a4e5785c896d76b2a9376"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a553d324884a4e5785c896d76b2a9376"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a553d324884a4e5785c896d76b2a9376"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:38:27 user devstack@n-api.service[72745]: X-Tenant: tempest-TaggedBootDevicesTest-615877170 Apr 17 10:38:27 user devstack@n-api.service[72745]: X-Tenant-Id: a553d324884a4e5785c896d76b2a9376 Apr 17 10:38:27 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-TaggedBootDevicesTest-615877170 Apr 17 10:38:27 user devstack@n-api.service[72745]: X-User: tempest-TaggedBootDevicesTest-615877170-project-member Apr 17 10:38:27 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:38:27 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:38:27 user devstack@n-api.service[72745]: X-User-Id: 41eaa1a7dc224ec4bd8ebd5fdef1fbeb Apr 17 10:38:27 user devstack@n-api.service[72745]: X-User-Name: tempest-TaggedBootDevicesTest-615877170-project-member Apr 17 10:38:27 user devstack@n-api.service[72745]: method: > Apr 17 10:38:27 user devstack@n-api.service[72745]: exception: Instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 could not be found. Apr 17 10:38:27 user devstack@n-api.service[72745]: action_args: {'id': '250f2cd2-b6ba-4a89-921f-cbd21ac36525'} Apr 17 10:38:27 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 could not be found. Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 could not be found. Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 could not be found. Apr 17 10:38:27 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:38:27 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-d877bd5e-0284-4d74-bcef-c3e52a7a1979 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Returning 404 to user: Instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:38:27 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-d877bd5e-0284-4d74-bcef-c3e52a7a1979 tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/250f2cd2-b6ba-4a89-921f-cbd21ac36525" status: 404 len: 111 microversion: 2.32 time: 0.039238 Apr 17 10:38:27 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 103/293] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 17 10:38:27 2023] DELETE /compute/v2.1/servers/250f2cd2-b6ba-4a89-921f-cbd21ac36525 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 10:38:27 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-3ae1a9db-bc4a-433c-819c-6294edafe42d tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:38:27 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-3ae1a9db-bc4a-433c-819c-6294edafe42d tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] [instance: 250f2cd2-b6ba-4a89-921f-cbd21ac36525] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:27 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3ae1a9db-bc4a-433c-819c-6294edafe42d tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:27 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3ae1a9db-bc4a-433c-819c-6294edafe42d tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:27 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3ae1a9db-bc4a-433c-819c-6294edafe42d tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:27 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3ae1a9db-bc4a-433c-819c-6294edafe42d tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:27 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3ae1a9db-bc4a-433c-819c-6294edafe42d tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:27 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3ae1a9db-bc4a-433c-819c-6294edafe42d tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:27 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-3ae1a9db-bc4a-433c-819c-6294edafe42d tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] HTTP exception thrown: Instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 could not be found. Apr 17 10:38:27 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-3ae1a9db-bc4a-433c-819c-6294edafe42d tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Request method failure captured: Apr 17 10:38:27 user devstack@n-api.service[72743]: request: GET /compute/v2.1/servers/250f2cd2-b6ba-4a89-921f-cbd21ac36525 HTTP/1.1 Apr 17 10:38:27 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:38:27 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:38:27 user devstack@n-api.service[72743]: Connection: close Apr 17 10:38:27 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:38:27 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:38:27 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:38:27 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:38:27 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:38:27 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSCrf2Tk_r45VxlkmxzxIwOJe7SmYdH-FBgBkG4NuEw6AZ6Ki2cp2K5CU_k1vaCsNBRULeEnfjlUh_qinsotKmZ9LzjywBAdz4ol0y2qHnfepOyTw0PEGIFIZRbLfQI8d7Hg0ZgYDdG-iyBdsmcB-JusKeilAF7UDYMjnMGlSn9nFwE Apr 17 10:38:27 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:38:27 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:38:27 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:38:27 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:38:27 user devstack@n-api.service[72743]: X-Openstack-Nova-Api-Version: 2.32 Apr 17 10:38:27 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:38:27 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:38:27 user devstack@n-api.service[72743]: X-Project-Id: a553d324884a4e5785c896d76b2a9376 Apr 17 10:38:27 user devstack@n-api.service[72743]: X-Project-Name: tempest-TaggedBootDevicesTest-615877170 Apr 17 10:38:27 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:38:27 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:38:27 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a553d324884a4e5785c896d76b2a9376"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a553d324884a4e5785c896d76b2a9376"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a553d324884a4e5785c896d76b2a9376"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:38:27 user devstack@n-api.service[72743]: X-Tenant: tempest-TaggedBootDevicesTest-615877170 Apr 17 10:38:27 user devstack@n-api.service[72743]: X-Tenant-Id: a553d324884a4e5785c896d76b2a9376 Apr 17 10:38:27 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-TaggedBootDevicesTest-615877170 Apr 17 10:38:27 user devstack@n-api.service[72743]: X-User: tempest-TaggedBootDevicesTest-615877170-project-member Apr 17 10:38:27 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:38:27 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:38:27 user devstack@n-api.service[72743]: X-User-Id: 41eaa1a7dc224ec4bd8ebd5fdef1fbeb Apr 17 10:38:27 user devstack@n-api.service[72743]: X-User-Name: tempest-TaggedBootDevicesTest-615877170-project-member Apr 17 10:38:27 user devstack@n-api.service[72743]: method: > Apr 17 10:38:27 user devstack@n-api.service[72743]: exception: Instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 could not be found. Apr 17 10:38:27 user devstack@n-api.service[72743]: action_args: {'id': '250f2cd2-b6ba-4a89-921f-cbd21ac36525'} Apr 17 10:38:27 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 could not be found. Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 could not be found. Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 could not be found. Apr 17 10:38:27 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:38:27 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-3ae1a9db-bc4a-433c-819c-6294edafe42d tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] Returning 404 to user: Instance 250f2cd2-b6ba-4a89-921f-cbd21ac36525 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:38:27 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-3ae1a9db-bc4a-433c-819c-6294edafe42d tempest-TaggedBootDevicesTest-615877170 tempest-TaggedBootDevicesTest-615877170-project-member] 10.0.0.210 "GET /compute/v2.1/servers/250f2cd2-b6ba-4a89-921f-cbd21ac36525" status: 404 len: 111 microversion: 2.32 time: 0.036684 Apr 17 10:38:27 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 101/294] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:38:27 2023] GET /compute/v2.1/servers/250f2cd2-b6ba-4a89-921f-cbd21ac36525 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 10:38:27 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-27d18ec5-0097-435c-8392-240175fd5592 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:38:27 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-27d18ec5-0097-435c-8392-240175fd5592 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:38:27 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-27d18ec5-0097-435c-8392-240175fd5592 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:38:27 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-27d18ec5-0097-435c-8392-240175fd5592 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d" status: 200 len: 1733 microversion: 2.20 time: 0.341702 Apr 17 10:38:27 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 91/295] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:38:26 2023] GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d => generated 1733 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:38:27 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-bdc40faf-bd1a-463a-b5f1-03b08193c631 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Action: 'create', calling method: .version_select at 0x7fc55a9053f0>, body: {"keypair": {"name": "tempest-keypair-1894950384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnn0G8T/NqKd4pdI8CnZBIrfuGV0OGYhlLKbelX5jBuYIOxA1KkpZDA2TZvP5aUxJYkJ3etLyosOZOXzhagUGOxEpiTev/9WWYjYrPv7DYs6AD3kMjO6NHdWKptKjHhkQ=="}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:27 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-bdc40faf-bd1a-463a-b5f1-03b08193c631 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Getting quotas for project 33eedb851ee244768016f5bf203d2f9f. Resources: {'key_pairs'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:38:27 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-bdc40faf-bd1a-463a-b5f1-03b08193c631 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Getting quotas for user f69d4d16a4bc479ba2a8a80f359135f7 and project 33eedb851ee244768016f5bf203d2f9f. Resources: {'key_pairs'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:38:27 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-bdc40faf-bd1a-463a-b5f1-03b08193c631 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.280645 Apr 17 10:38:27 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 104/296] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 10:38:27 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:38:28 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-728db696-8bdb-4dbc-989e-0b5c22d0763a tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:38:28 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-728db696-8bdb-4dbc-989e-0b5c22d0763a tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:28 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:38:28 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:38:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-728db696-8bdb-4dbc-989e-0b5c22d0763a tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-728db696-8bdb-4dbc-989e-0b5c22d0763a tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-728db696-8bdb-4dbc-989e-0b5c22d0763a tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-728db696-8bdb-4dbc-989e-0b5c22d0763a tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-728db696-8bdb-4dbc-989e-0b5c22d0763a tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-728db696-8bdb-4dbc-989e-0b5c22d0763a tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:29 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-728db696-8bdb-4dbc-989e-0b5c22d0763a tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282298df65264595b5d7351066128b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850462faec874544bdc01dd14746d558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:38:29 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-728db696-8bdb-4dbc-989e-0b5c22d0763a tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" status: 200 len: 1669 microversion: 2.1 time: 0.716114 Apr 17 10:38:29 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 102/297] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:38:28 2023] GET /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 => generated 1669 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:38:29 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1787327953", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "networks": [{"uuid": "0635a321-37ea-416c-9e45-a059e4a4a9bb"}], "security_groups": [{"name": "tempest-securitygroup--1548225211"}], "key_name": "tempest-keypair-1894950384", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:29 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:38:30 user devstack@n-api.service[72744]: DEBUG nova.network.neutron [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] validate_networks() for [('0635a321-37ea-416c-9e45-a059e4a4a9bb', None, None, None, None, None)] {{(pid=72744) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:38:30 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Flavor limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:38:30 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Image limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:38:30 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Flavor pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:38:30 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Image pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:38:30 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:38:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:30 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Getting quotas for project 33eedb851ee244768016f5bf203d2f9f. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:38:30 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Getting quotas for user f69d4d16a4bc479ba2a8a80f359135f7 and project 33eedb851ee244768016f5bf203d2f9f. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:38:30 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Going to run 1 instances... {{(pid=72744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:38:30 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:38:30 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-c7a54699-9b40-4bce-8857-b57898fc6a8c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.932016 Apr 17 10:38:30 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 92/298] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:38:29 2023] POST /compute/v2.1/servers => generated 404 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 10:38:30 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-a1628a12-cf41-4e27-a67b-7bb2991fa0ed tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:38:30 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-a1628a12-cf41-4e27-a67b-7bb2991fa0ed tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:30 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-a1628a12-cf41-4e27-a67b-7bb2991fa0ed tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69d4d16a4bc479ba2a8a80f359135f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33eedb851ee244768016f5bf203d2f9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:38:30 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-a1628a12-cf41-4e27-a67b-7bb2991fa0ed tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" status: 200 len: 1236 microversion: 2.1 time: 0.064666 Apr 17 10:38:30 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 105/299] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:38:30 2023] GET /compute/v2.1/servers/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf => generated 1236 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:38:31 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:31 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Going to try to start instance {{(pid=72743) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 17 10:38:31 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-d6107a90-916e-4bce-9c10-eb8a5022676b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "POST /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99/action" status: 202 len: 0 microversion: 2.1 time: 0.143475 Apr 17 10:38:31 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 103/300] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 10:38:31 2023] POST /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:38:31 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-edc27e77-7c77-4f1a-855c-a23e837e4869 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:38:31 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-edc27e77-7c77-4f1a-855c-a23e837e4869 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:31 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bdf94f31-0fa3-4682-abb5-161b0e318367"}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:31 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-edc27e77-7c77-4f1a-855c-a23e837e4869 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:31 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-edc27e77-7c77-4f1a-855c-a23e837e4869 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:31 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-edc27e77-7c77-4f1a-855c-a23e837e4869 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:31 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-edc27e77-7c77-4f1a-855c-a23e837e4869 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:31 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-edc27e77-7c77-4f1a-855c-a23e837e4869 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:31 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-edc27e77-7c77-4f1a-855c-a23e837e4869 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:31 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:32 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-edc27e77-7c77-4f1a-855c-a23e837e4869 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9862432f87f4500a46f32a0b27d54d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a17ec3e1b314acbb701f2d2d27d0560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:38:32 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-edc27e77-7c77-4f1a-855c-a23e837e4869 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99" status: 200 len: 1694 microversion: 2.1 time: 0.295852 Apr 17 10:38:32 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 106/301] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:38:31 2023] GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99 => generated 1694 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 17 10:38:32 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-44d2fe89-7c98-4dbb-981c-f8d829a28ccd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.549911 Apr 17 10:38:32 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 93/302] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Apr 17 10:38:31 2023] POST /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/os-volume_attachments => generated 194 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:38:32 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-fa1de08b-4d4c-4442-8713-45c31d14578b tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:38:32 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-fa1de08b-4d4c-4442-8713-45c31d14578b tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fa1de08b-4d4c-4442-8713-45c31d14578b tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fa1de08b-4d4c-4442-8713-45c31d14578b tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fa1de08b-4d4c-4442-8713-45c31d14578b tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fa1de08b-4d4c-4442-8713-45c31d14578b tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fa1de08b-4d4c-4442-8713-45c31d14578b tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fa1de08b-4d4c-4442-8713-45c31d14578b tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:32 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-fa1de08b-4d4c-4442-8713-45c31d14578b tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055978 Apr 17 10:38:32 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 104/303] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:38:32 2023] GET /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 17 10:38:33 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-1347e9f3-c83d-47c7-9b9b-f685f3b563dd req-961be25e-5014-4b6a-a91f-e2ffc53ce39a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab", "name": "network-vif-plugged", "status": "completed", "tag": "2acfe658-2dce-4086-b24a-ef0b4c3714f8"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:33 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-1347e9f3-c83d-47c7-9b9b-f685f3b563dd req-961be25e-5014-4b6a-a91f-e2ffc53ce39a service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:33 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-1347e9f3-c83d-47c7-9b9b-f685f3b563dd req-961be25e-5014-4b6a-a91f-e2ffc53ce39a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:33 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-1347e9f3-c83d-47c7-9b9b-f685f3b563dd req-961be25e-5014-4b6a-a91f-e2ffc53ce39a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:33 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-1347e9f3-c83d-47c7-9b9b-f685f3b563dd req-961be25e-5014-4b6a-a91f-e2ffc53ce39a service nova] Creating event network-vif-plugged:2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab on user Apr 17 10:38:33 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-1347e9f3-c83d-47c7-9b9b-f685f3b563dd req-961be25e-5014-4b6a-a91f-e2ffc53ce39a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032279 Apr 17 10:38:33 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 107/304] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:38:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:38:34 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-2baec35a-7a45-4268-9400-4c220e925e53 req-464b7432-0842-435b-840a-7989edb9994d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf", "tag": "e66863ce-1b10-4701-9a7c-3940117a0237"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:34 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-2baec35a-7a45-4268-9400-4c220e925e53 req-464b7432-0842-435b-840a-7989edb9994d service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:34 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-2baec35a-7a45-4268-9400-4c220e925e53 req-464b7432-0842-435b-840a-7989edb9994d service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:34 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-2baec35a-7a45-4268-9400-4c220e925e53 req-464b7432-0842-435b-840a-7989edb9994d service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:34 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-2baec35a-7a45-4268-9400-4c220e925e53 req-464b7432-0842-435b-840a-7989edb9994d service nova] Creating event network-changed:e66863ce-1b10-4701-9a7c-3940117a0237 for instance 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf on user Apr 17 10:38:34 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-2baec35a-7a45-4268-9400-4c220e925e53 req-464b7432-0842-435b-840a-7989edb9994d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051817 Apr 17 10:38:34 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 94/305] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:38:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:38:35 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-6eff3ace-d7e4-4d11-8328-f3c8dff4a9ef req-d1571aec-ec5f-439f-919d-60619fd73a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab", "name": "network-vif-plugged", "status": "completed", "tag": "2acfe658-2dce-4086-b24a-ef0b4c3714f8"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-6eff3ace-d7e4-4d11-8328-f3c8dff4a9ef req-d1571aec-ec5f-439f-919d-60619fd73a6d service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-6eff3ace-d7e4-4d11-8328-f3c8dff4a9ef req-d1571aec-ec5f-439f-919d-60619fd73a6d service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-6eff3ace-d7e4-4d11-8328-f3c8dff4a9ef req-d1571aec-ec5f-439f-919d-60619fd73a6d service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:35 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-6eff3ace-d7e4-4d11-8328-f3c8dff4a9ef req-d1571aec-ec5f-439f-919d-60619fd73a6d service nova] Creating event network-vif-plugged:2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab on user Apr 17 10:38:35 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-6eff3ace-d7e4-4d11-8328-f3c8dff4a9ef req-d1571aec-ec5f-439f-919d-60619fd73a6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036498 Apr 17 10:38:35 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 105/306] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:38:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:38:36 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-273d39bb-f50f-44f1-97d7-c0396f99f62d req-12496163-768e-49ec-b556-3adc53d639d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4315753-415c-45cd-b06f-da1e3ccc6e4d", "tag": "cd279a0c-99eb-4e32-876e-6d2208cc1db2"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:36 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-273d39bb-f50f-44f1-97d7-c0396f99f62d req-12496163-768e-49ec-b556-3adc53d639d3 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:36 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-273d39bb-f50f-44f1-97d7-c0396f99f62d req-12496163-768e-49ec-b556-3adc53d639d3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:36 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-273d39bb-f50f-44f1-97d7-c0396f99f62d req-12496163-768e-49ec-b556-3adc53d639d3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:36 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-273d39bb-f50f-44f1-97d7-c0396f99f62d req-12496163-768e-49ec-b556-3adc53d639d3 service nova] Creating event network-changed:cd279a0c-99eb-4e32-876e-6d2208cc1db2 for instance c4315753-415c-45cd-b06f-da1e3ccc6e4d on user Apr 17 10:38:36 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-273d39bb-f50f-44f1-97d7-c0396f99f62d req-12496163-768e-49ec-b556-3adc53d639d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050626 Apr 17 10:38:36 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 108/307] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:38:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:38:37 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-2166e201-e827-4d92-9f29-435d686c0035 req-f1ded636-dd5d-4481-a3f4-be9513936e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf", "name": "network-vif-plugged", "status": "completed", "tag": "e66863ce-1b10-4701-9a7c-3940117a0237"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-2166e201-e827-4d92-9f29-435d686c0035 req-f1ded636-dd5d-4481-a3f4-be9513936e89 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-2166e201-e827-4d92-9f29-435d686c0035 req-f1ded636-dd5d-4481-a3f4-be9513936e89 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-2166e201-e827-4d92-9f29-435d686c0035 req-f1ded636-dd5d-4481-a3f4-be9513936e89 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:37 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-2166e201-e827-4d92-9f29-435d686c0035 req-f1ded636-dd5d-4481-a3f4-be9513936e89 service nova] Creating event network-vif-plugged:e66863ce-1b10-4701-9a7c-3940117a0237 for instance 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf on user Apr 17 10:38:37 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-2166e201-e827-4d92-9f29-435d686c0035 req-f1ded636-dd5d-4481-a3f4-be9513936e89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060226 Apr 17 10:38:37 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 95/308] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:38:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:38:39 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-4b7d25ca-93dc-416d-8760-f231c2e18b99 req-39de6d2d-4219-4bb7-b060-d93a301e51ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59fd26de-d46e-4f41-91f6-090005a07d99", "name": "network-vif-plugged", "status": "completed", "tag": "7124043d-665c-4a42-a041-b91ccc237b63"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:39 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-4b7d25ca-93dc-416d-8760-f231c2e18b99 req-39de6d2d-4219-4bb7-b060-d93a301e51ca service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:39 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-4b7d25ca-93dc-416d-8760-f231c2e18b99 req-39de6d2d-4219-4bb7-b060-d93a301e51ca service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:39 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-4b7d25ca-93dc-416d-8760-f231c2e18b99 req-39de6d2d-4219-4bb7-b060-d93a301e51ca service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:39 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-4b7d25ca-93dc-416d-8760-f231c2e18b99 req-39de6d2d-4219-4bb7-b060-d93a301e51ca service nova] Creating event network-vif-plugged:7124043d-665c-4a42-a041-b91ccc237b63 for instance 59fd26de-d46e-4f41-91f6-090005a07d99 on user Apr 17 10:38:39 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-4b7d25ca-93dc-416d-8760-f231c2e18b99 req-39de6d2d-4219-4bb7-b060-d93a301e51ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044361 Apr 17 10:38:39 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 106/309] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:38:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:38:39 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-c47e5a32-ecdf-4932-a92a-59bd6eca327b req-f8b7d2db-7660-4cc6-b81a-d44f0a7524db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf", "name": "network-vif-plugged", "status": "completed", "tag": "e66863ce-1b10-4701-9a7c-3940117a0237"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:39 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-c47e5a32-ecdf-4932-a92a-59bd6eca327b req-f8b7d2db-7660-4cc6-b81a-d44f0a7524db service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:39 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-c47e5a32-ecdf-4932-a92a-59bd6eca327b req-f8b7d2db-7660-4cc6-b81a-d44f0a7524db service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:39 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-c47e5a32-ecdf-4932-a92a-59bd6eca327b req-f8b7d2db-7660-4cc6-b81a-d44f0a7524db service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:39 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-c47e5a32-ecdf-4932-a92a-59bd6eca327b req-f8b7d2db-7660-4cc6-b81a-d44f0a7524db service nova] Creating event network-vif-plugged:e66863ce-1b10-4701-9a7c-3940117a0237 for instance 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf on user Apr 17 10:38:39 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-c47e5a32-ecdf-4932-a92a-59bd6eca327b req-f8b7d2db-7660-4cc6-b81a-d44f0a7524db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048719 Apr 17 10:38:39 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 109/310] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:38:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:38:40 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:38:40 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:38:40 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74dc9a66-6730-41d3-95e1-920360e21cb9"}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:40 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:41 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-f9fd14d0-9ea9-4e90-9f94-c1c345cf0248 req-a7af79cc-eae3-489a-a8ac-4c8072a9bd80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59fd26de-d46e-4f41-91f6-090005a07d99", "name": "network-vif-plugged", "status": "completed", "tag": "7124043d-665c-4a42-a041-b91ccc237b63"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:41 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-f9fd14d0-9ea9-4e90-9f94-c1c345cf0248 req-a7af79cc-eae3-489a-a8ac-4c8072a9bd80 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:41 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-f9fd14d0-9ea9-4e90-9f94-c1c345cf0248 req-a7af79cc-eae3-489a-a8ac-4c8072a9bd80 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:41 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-f9fd14d0-9ea9-4e90-9f94-c1c345cf0248 req-a7af79cc-eae3-489a-a8ac-4c8072a9bd80 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:41 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-f9fd14d0-9ea9-4e90-9f94-c1c345cf0248 req-a7af79cc-eae3-489a-a8ac-4c8072a9bd80 service nova] Creating event network-vif-plugged:7124043d-665c-4a42-a041-b91ccc237b63 for instance 59fd26de-d46e-4f41-91f6-090005a07d99 on user Apr 17 10:38:41 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-f9fd14d0-9ea9-4e90-9f94-c1c345cf0248 req-a7af79cc-eae3-489a-a8ac-4c8072a9bd80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044539 Apr 17 10:38:41 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 107/311] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:38:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:38:41 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-5fd3504b-edb9-484f-8e39-818117ab5659 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.502488 Apr 17 10:38:41 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 96/312] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Apr 17 10:38:40 2023] POST /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments => generated 194 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:38:43 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:38:43 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "1d484d43-a1db-4806-ae9e-7be2347dbfec"}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:43 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:43 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:43 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:43 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:43 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:43 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:43 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:43 user devstack@n-api.service[72745]: DEBUG nova.objects.instance [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lazy-loading 'flavor' on Instance uuid e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 {{(pid=72745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 10:38:43 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-96b43026-9ebe-443b-a478-0fe5de20533d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/action" status: 200 len: 29 microversion: 2.1 time: 0.352334 Apr 17 10:38:43 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 110/313] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 10:38:43 2023] POST /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/action => generated 29 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 17 10:38:44 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-717f6383-05b2-4d87-bedd-4c22925a99c0 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:38:44 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-717f6383-05b2-4d87-bedd-4c22925a99c0 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-717f6383-05b2-4d87-bedd-4c22925a99c0 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-717f6383-05b2-4d87-bedd-4c22925a99c0 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-717f6383-05b2-4d87-bedd-4c22925a99c0 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-717f6383-05b2-4d87-bedd-4c22925a99c0 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-717f6383-05b2-4d87-bedd-4c22925a99c0 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-717f6383-05b2-4d87-bedd-4c22925a99c0 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:45 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-717f6383-05b2-4d87-bedd-4c22925a99c0 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282298df65264595b5d7351066128b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850462faec874544bdc01dd14746d558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:38:45 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-717f6383-05b2-4d87-bedd-4c22925a99c0 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" status: 200 len: 1721 microversion: 2.1 time: 1.203567 Apr 17 10:38:45 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 108/314] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:38:44 2023] GET /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 => generated 1721 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:38:46 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-93c0bcd3-ec28-4347-881f-6cd75142328a req-161b00c0-86b7-4839-91ca-1fa08b151131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4315753-415c-45cd-b06f-da1e3ccc6e4d", "name": "network-vif-plugged", "status": "completed", "tag": "cd279a0c-99eb-4e32-876e-6d2208cc1db2"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:46 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:38:46 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-93c0bcd3-ec28-4347-881f-6cd75142328a req-161b00c0-86b7-4839-91ca-1fa08b151131 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:46 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-93c0bcd3-ec28-4347-881f-6cd75142328a req-161b00c0-86b7-4839-91ca-1fa08b151131 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:46 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-93c0bcd3-ec28-4347-881f-6cd75142328a req-161b00c0-86b7-4839-91ca-1fa08b151131 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:46 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:38:46 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-93c0bcd3-ec28-4347-881f-6cd75142328a req-161b00c0-86b7-4839-91ca-1fa08b151131 service nova] Creating event network-vif-plugged:cd279a0c-99eb-4e32-876e-6d2208cc1db2 for instance c4315753-415c-45cd-b06f-da1e3ccc6e4d on user Apr 17 10:38:46 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-93c0bcd3-ec28-4347-881f-6cd75142328a req-161b00c0-86b7-4839-91ca-1fa08b151131 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052093 Apr 17 10:38:46 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 97/315] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:38:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:38:48 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-fe7c6d18-a250-4486-8d76-4869f5af7dcc req-ac0b7e24-7afa-4ade-9775-7aafa0ca03de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4315753-415c-45cd-b06f-da1e3ccc6e4d", "name": "network-vif-plugged", "status": "completed", "tag": "cd279a0c-99eb-4e32-876e-6d2208cc1db2"}, {"server_uuid": "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4", "name": "network-vif-unplugged", "status": "completed", "tag": "f839dea5-4294-4842-bfa2-262351dabfb9"}, {"server_uuid": "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4", "name": "network-vif-plugged", "status": "completed", "tag": "f839dea5-4294-4842-bfa2-262351dabfb9"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:48 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:38:48 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-fe7c6d18-a250-4486-8d76-4869f5af7dcc req-ac0b7e24-7afa-4ade-9775-7aafa0ca03de service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:48 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-fe7c6d18-a250-4486-8d76-4869f5af7dcc req-ac0b7e24-7afa-4ade-9775-7aafa0ca03de service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:48 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-fe7c6d18-a250-4486-8d76-4869f5af7dcc req-ac0b7e24-7afa-4ade-9775-7aafa0ca03de service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:48 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=8,nova_cell1:INSERT=5 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:38:48 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-fe7c6d18-a250-4486-8d76-4869f5af7dcc req-ac0b7e24-7afa-4ade-9775-7aafa0ca03de service nova] Creating event network-vif-plugged:cd279a0c-99eb-4e32-876e-6d2208cc1db2 for instance c4315753-415c-45cd-b06f-da1e3ccc6e4d on user Apr 17 10:38:48 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-fe7c6d18-a250-4486-8d76-4869f5af7dcc req-ac0b7e24-7afa-4ade-9775-7aafa0ca03de service nova] Creating event network-vif-unplugged:f839dea5-4294-4842-bfa2-262351dabfb9 for instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 on user Apr 17 10:38:48 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-fe7c6d18-a250-4486-8d76-4869f5af7dcc req-ac0b7e24-7afa-4ade-9775-7aafa0ca03de service nova] Creating event network-vif-plugged:f839dea5-4294-4842-bfa2-262351dabfb9 for instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 on user Apr 17 10:38:48 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-fe7c6d18-a250-4486-8d76-4869f5af7dcc req-ac0b7e24-7afa-4ade-9775-7aafa0ca03de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.129298 Apr 17 10:38:48 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 111/316] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:38:48 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:38:49 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-df09d290-7aae-4bc9-9504-410b4fb6502a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:38:49 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-df09d290-7aae-4bc9-9504-410b4fb6502a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:49 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:38:49 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-df09d290-7aae-4bc9-9504-410b4fb6502a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:49 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-df09d290-7aae-4bc9-9504-410b4fb6502a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:49 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-df09d290-7aae-4bc9-9504-410b4fb6502a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:49 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-df09d290-7aae-4bc9-9504-410b4fb6502a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:49 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-df09d290-7aae-4bc9-9504-410b4fb6502a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:49 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-df09d290-7aae-4bc9-9504-410b4fb6502a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:49 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:38:50 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-df09d290-7aae-4bc9-9504-410b4fb6502a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab512fbd85694415a5f7af8b689814d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507228fb562e461e91a628829ce32d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:38:50 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-df09d290-7aae-4bc9-9504-410b4fb6502a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab512fbd85694415a5f7af8b689814d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507228fb562e461e91a628829ce32d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:38:50 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-df09d290-7aae-4bc9-9504-410b4fb6502a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab512fbd85694415a5f7af8b689814d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507228fb562e461e91a628829ce32d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:38:50 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-df09d290-7aae-4bc9-9504-410b4fb6502a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" status: 200 len: 1627 microversion: 2.49 time: 0.709896 Apr 17 10:38:50 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 109/317] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:38:49 2023] GET /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 => generated 1627 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:38:51 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:38:51 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:51 user devstack@n-api.service[72744]: DEBUG nova.objects.instance [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lazy-loading 'services' on Instance uuid 7792cf72-dc73-4201-9501-4515ce860735 {{(pid=72744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 10:38:52 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-434cbf46-1eae-43ab-b1bc-d25da8af6aa3 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments/74dc9a66-6730-41d3-95e1-920360e21cb9" status: 202 len: 0 microversion: 2.1 time: 0.246571 Apr 17 10:38:52 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 98/318] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Apr 17 10:38:51 2023] DELETE /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments/74dc9a66-6730-41d3-95e1-920360e21cb9 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:38:52 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-1ff9bcd5-f398-4777-845d-5f8b301ec373 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:38:52 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-1ff9bcd5-f398-4777-845d-5f8b301ec373 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:38:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1ff9bcd5-f398-4777-845d-5f8b301ec373 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1ff9bcd5-f398-4777-845d-5f8b301ec373 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1ff9bcd5-f398-4777-845d-5f8b301ec373 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1ff9bcd5-f398-4777-845d-5f8b301ec373 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1ff9bcd5-f398-4777-845d-5f8b301ec373 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1ff9bcd5-f398-4777-845d-5f8b301ec373 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:52 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-1ff9bcd5-f398-4777-845d-5f8b301ec373 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102392 Apr 17 10:38:52 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 112/319] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:38:52 2023] GET /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:38:52 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-100414ca-1408-4c68-83ac-9433a89225ef req-b66b093a-eff5-4f46-b719-040c5b1a1365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4", "name": "network-vif-plugged", "status": "completed", "tag": "f839dea5-4294-4842-bfa2-262351dabfb9"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:52 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-100414ca-1408-4c68-83ac-9433a89225ef req-b66b093a-eff5-4f46-b719-040c5b1a1365 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:52 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-100414ca-1408-4c68-83ac-9433a89225ef req-b66b093a-eff5-4f46-b719-040c5b1a1365 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:52 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-100414ca-1408-4c68-83ac-9433a89225ef req-b66b093a-eff5-4f46-b719-040c5b1a1365 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:52 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-100414ca-1408-4c68-83ac-9433a89225ef req-b66b093a-eff5-4f46-b719-040c5b1a1365 service nova] Creating event network-vif-plugged:f839dea5-4294-4842-bfa2-262351dabfb9 for instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 on user Apr 17 10:38:52 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-100414ca-1408-4c68-83ac-9433a89225ef req-b66b093a-eff5-4f46-b719-040c5b1a1365 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051794 Apr 17 10:38:52 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 110/320] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:38:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:38:54 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-de8608d0-1eba-4552-afb5-cae229758c29 req-994981ed-9129-4bab-bb17-aad79dbf3cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4", "name": "network-vif-plugged", "status": "completed", "tag": "f839dea5-4294-4842-bfa2-262351dabfb9"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:38:54 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-de8608d0-1eba-4552-afb5-cae229758c29 req-994981ed-9129-4bab-bb17-aad79dbf3cd3 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:38:54 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-de8608d0-1eba-4552-afb5-cae229758c29 req-994981ed-9129-4bab-bb17-aad79dbf3cd3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:38:54 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-de8608d0-1eba-4552-afb5-cae229758c29 req-994981ed-9129-4bab-bb17-aad79dbf3cd3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:38:54 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-de8608d0-1eba-4552-afb5-cae229758c29 req-994981ed-9129-4bab-bb17-aad79dbf3cd3 service nova] Creating event network-vif-plugged:f839dea5-4294-4842-bfa2-262351dabfb9 for instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 on user Apr 17 10:38:54 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-de8608d0-1eba-4552-afb5-cae229758c29 req-994981ed-9129-4bab-bb17-aad79dbf3cd3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030042 Apr 17 10:38:54 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 99/321] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:38:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:39:04 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=3 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:39:04 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=7 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:39:04 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-604329460", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "networks": [{"uuid": "d72c00d6-55cf-4a6c-9d41-f5bbe89865d8"}]}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:39:04 user devstack@n-api.service[72745]: DEBUG nova.network.neutron [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] validate_networks() for [('d72c00d6-55cf-4a6c-9d41-f5bbe89865d8', None, None, None, None, None)] {{(pid=72745) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:39:04 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Flavor limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:39:04 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Image limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:39:04 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Flavor pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:39:04 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Image pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:39:04 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:39:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:04 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Getting quotas for project a8b831c3b6c244dda1821583a6b8cd08. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:39:04 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Getting quotas for user 1e61a5e172c34636b183ef9c84b714d8 and project a8b831c3b6c244dda1821583a6b8cd08. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:39:04 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Going to run 1 instances... {{(pid=72745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:39:04 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:39:05 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-b6cbe521-d62b-4641-b7cc-f6955fea22d7 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.913380 Apr 17 10:39:05 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 113/322] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:39:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 10:39:05 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=3 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:39:05 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=7 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:39:05 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-79c4d552-b9d7-4740-8902-aebe465d39db tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:39:05 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-79c4d552-b9d7-4740-8902-aebe465d39db tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:39:05 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-79c4d552-b9d7-4740-8902-aebe465d39db tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e61a5e172c34636b183ef9c84b714d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b831c3b6c244dda1821583a6b8cd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:39:05 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-79c4d552-b9d7-4740-8902-aebe465d39db tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e03807e-942b-4155-835b-b1c86f5b80f5" status: 200 len: 1210 microversion: 2.1 time: 0.077236 Apr 17 10:39:05 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 111/323] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:39:05 2023] GET /compute/v2.1/servers/5e03807e-942b-4155-835b-b1c86f5b80f5 => generated 1210 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:39:07 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=5 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:39:07 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=12,nova_cell1:INSERT=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:39:07 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-8073d5c4-a33b-4a1b-92c2-5acb6d6d05e5 req-44ca785d-9889-4f6c-a3e0-8f11000fe130 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e03807e-942b-4155-835b-b1c86f5b80f5", "tag": "b7885763-79d0-44c2-bc9d-4a434792584a"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:39:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-8073d5c4-a33b-4a1b-92c2-5acb6d6d05e5 req-44ca785d-9889-4f6c-a3e0-8f11000fe130 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-8073d5c4-a33b-4a1b-92c2-5acb6d6d05e5 req-44ca785d-9889-4f6c-a3e0-8f11000fe130 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-8073d5c4-a33b-4a1b-92c2-5acb6d6d05e5 req-44ca785d-9889-4f6c-a3e0-8f11000fe130 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:07 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-8073d5c4-a33b-4a1b-92c2-5acb6d6d05e5 req-44ca785d-9889-4f6c-a3e0-8f11000fe130 service nova] Creating event network-changed:b7885763-79d0-44c2-bc9d-4a434792584a for instance 5e03807e-942b-4155-835b-b1c86f5b80f5 on user Apr 17 10:39:07 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-8073d5c4-a33b-4a1b-92c2-5acb6d6d05e5 req-44ca785d-9889-4f6c-a3e0-8f11000fe130 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037144 Apr 17 10:39:07 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 100/324] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:39:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:39:08 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-463c5bed-646d-40b6-ac47-6f1e07c477c5 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:39:08 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-463c5bed-646d-40b6-ac47-6f1e07c477c5 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:39:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-463c5bed-646d-40b6-ac47-6f1e07c477c5 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-463c5bed-646d-40b6-ac47-6f1e07c477c5 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-463c5bed-646d-40b6-ac47-6f1e07c477c5 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-463c5bed-646d-40b6-ac47-6f1e07c477c5 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-463c5bed-646d-40b6-ac47-6f1e07c477c5 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-463c5bed-646d-40b6-ac47-6f1e07c477c5 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:08 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-463c5bed-646d-40b6-ac47-6f1e07c477c5 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:39:08 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-463c5bed-646d-40b6-ac47-6f1e07c477c5 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:39:08 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-463c5bed-646d-40b6-ac47-6f1e07c477c5 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:39:08 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-463c5bed-646d-40b6-ac47-6f1e07c477c5 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" status: 200 len: 1769 microversion: 2.87 time: 0.286597 Apr 17 10:39:08 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 114/325] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:39:08 2023] GET /compute/v2.1/servers/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab => generated 1769 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:39:08 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-9c2ce79b-f273-4948-b99f-04ee3a3553ed tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:39:08 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-9c2ce79b-f273-4948-b99f-04ee3a3553ed tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:39:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-9c2ce79b-f273-4948-b99f-04ee3a3553ed tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-9c2ce79b-f273-4948-b99f-04ee3a3553ed tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-9c2ce79b-f273-4948-b99f-04ee3a3553ed tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-9c2ce79b-f273-4948-b99f-04ee3a3553ed tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-9c2ce79b-f273-4948-b99f-04ee3a3553ed tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-9c2ce79b-f273-4948-b99f-04ee3a3553ed tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:08 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-9c2ce79b-f273-4948-b99f-04ee3a3553ed tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43c0aee7b05459d898e0dc2654262fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a793afb3e7045898c59a77975079d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:39:08 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-9c2ce79b-f273-4948-b99f-04ee3a3553ed tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0c707ac-b08f-4f18-8262-e1b79d7e17e1" status: 200 len: 1497 microversion: 2.1 time: 0.244938 Apr 17 10:39:08 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 112/326] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:39:08 2023] GET /compute/v2.1/servers/b0c707ac-b08f-4f18-8262-e1b79d7e17e1 => generated 1497 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:39:09 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-eb9d1194-769a-48a6-a124-386091173266 req-f5eff022-4962-4753-a4d5-6647288b3183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e03807e-942b-4155-835b-b1c86f5b80f5", "name": "network-vif-plugged", "status": "completed", "tag": "b7885763-79d0-44c2-bc9d-4a434792584a"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:39:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-eb9d1194-769a-48a6-a124-386091173266 req-f5eff022-4962-4753-a4d5-6647288b3183 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-eb9d1194-769a-48a6-a124-386091173266 req-f5eff022-4962-4753-a4d5-6647288b3183 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-eb9d1194-769a-48a6-a124-386091173266 req-f5eff022-4962-4753-a4d5-6647288b3183 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:09 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-eb9d1194-769a-48a6-a124-386091173266 req-f5eff022-4962-4753-a4d5-6647288b3183 service nova] Creating event network-vif-plugged:b7885763-79d0-44c2-bc9d-4a434792584a for instance 5e03807e-942b-4155-835b-b1c86f5b80f5 on user Apr 17 10:39:09 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-eb9d1194-769a-48a6-a124-386091173266 req-f5eff022-4962-4753-a4d5-6647288b3183 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075238 Apr 17 10:39:09 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 101/327] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:39:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:39:10 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-c20a848d-040f-4788-bf5d-96c2683c678e tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:39:10 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-c20a848d-040f-4788-bf5d-96c2683c678e tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] [instance: 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:39:10 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c20a848d-040f-4788-bf5d-96c2683c678e tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:10 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c20a848d-040f-4788-bf5d-96c2683c678e tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:10 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c20a848d-040f-4788-bf5d-96c2683c678e tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:10 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c20a848d-040f-4788-bf5d-96c2683c678e tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:10 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c20a848d-040f-4788-bf5d-96c2683c678e tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:10 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c20a848d-040f-4788-bf5d-96c2683c678e tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:10 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-c20a848d-040f-4788-bf5d-96c2683c678e tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] HTTP exception thrown: Instance 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d could not be found. Apr 17 10:39:10 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-c20a848d-040f-4788-bf5d-96c2683c678e tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Request method failure captured: Apr 17 10:39:10 user devstack@n-api.service[72745]: request: GET /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d HTTP/1.1 Apr 17 10:39:10 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:39:10 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:39:10 user devstack@n-api.service[72745]: Connection: close Apr 17 10:39:10 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 10:39:10 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:39:10 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:39:10 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:39:10 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:39:10 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSCxZ8gH7Ht1REnw3tQ825ODGagIWmRAzXGavVh15iXmKrsf7tTaNmTytHhJGj0MlHIXfMtZKfgm-q9dwIC8GA-Y7SmnN3zCiEbBDwi2f0Lzp6WgSy82Wcx_VRitSVxQxG93Q9QCHxgQbA1ejALQPjm0xyUDD8joj5RxNt_XGbL3IIU Apr 17 10:39:10 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:39:10 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:39:10 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:39:10 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:39:10 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:39:10 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:39:10 user devstack@n-api.service[72745]: X-Project-Id: 74ad2dd86dc14ead939b4fdca5a97a35 Apr 17 10:39:10 user devstack@n-api.service[72745]: X-Project-Name: tempest-TestVolumeSwap-1885282809 Apr 17 10:39:10 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:39:10 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:39:10 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/74ad2dd86dc14ead939b4fdca5a97a35"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/74ad2dd86dc14ead939b4fdca5a97a35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/74ad2dd86dc14ead939b4fdca5a97a35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:39:10 user devstack@n-api.service[72745]: X-Tenant: tempest-TestVolumeSwap-1885282809 Apr 17 10:39:10 user devstack@n-api.service[72745]: X-Tenant-Id: 74ad2dd86dc14ead939b4fdca5a97a35 Apr 17 10:39:10 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-TestVolumeSwap-1885282809 Apr 17 10:39:10 user devstack@n-api.service[72745]: X-User: tempest-TestVolumeSwap-1885282809-project-member Apr 17 10:39:10 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:39:10 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:39:10 user devstack@n-api.service[72745]: X-User-Id: c18c3804bb0449c8bba3b56df41ccc99 Apr 17 10:39:10 user devstack@n-api.service[72745]: X-User-Name: tempest-TestVolumeSwap-1885282809-project-member Apr 17 10:39:10 user devstack@n-api.service[72745]: method: > Apr 17 10:39:10 user devstack@n-api.service[72745]: exception: Instance 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d could not be found. Apr 17 10:39:10 user devstack@n-api.service[72745]: action_args: {'id': '3336cde8-eedb-4d3e-8c20-b79cd2d1f51d'} Apr 17 10:39:10 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d could not be found. Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d could not be found. Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d could not be found. Apr 17 10:39:10 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:39:10 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-c20a848d-040f-4788-bf5d-96c2683c678e tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Returning 404 to user: Instance 3336cde8-eedb-4d3e-8c20-b79cd2d1f51d could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:39:10 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-c20a848d-040f-4788-bf5d-96c2683c678e tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d" status: 404 len: 111 microversion: 2.1 time: 0.026955 Apr 17 10:39:10 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 115/328] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:39:10 2023] GET /compute/v2.1/servers/3336cde8-eedb-4d3e-8c20-b79cd2d1f51d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:39:10 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-a725e094-0a0d-45a2-9c63-b0814594ddd2 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] Calling method '.version_select at 0x7fc55aaeb880>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:39:10 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-a725e094-0a0d-45a2-9c63-b0814594ddd2 tempest-TestVolumeSwap-1885282809 tempest-TestVolumeSwap-1885282809-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1885421127" status: 202 len: 0 microversion: 2.1 time: 0.023064 Apr 17 10:39:10 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 113/329] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Apr 17 10:39:10 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1885421127 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:39:11 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-470193b5-46b6-4d30-bc2a-b2391bd42820 req-b3bc7283-446f-4d47-a83e-4cb029f99936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e03807e-942b-4155-835b-b1c86f5b80f5", "name": "network-vif-plugged", "status": "completed", "tag": "b7885763-79d0-44c2-bc9d-4a434792584a"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:39:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-470193b5-46b6-4d30-bc2a-b2391bd42820 req-b3bc7283-446f-4d47-a83e-4cb029f99936 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-470193b5-46b6-4d30-bc2a-b2391bd42820 req-b3bc7283-446f-4d47-a83e-4cb029f99936 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-470193b5-46b6-4d30-bc2a-b2391bd42820 req-b3bc7283-446f-4d47-a83e-4cb029f99936 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-470193b5-46b6-4d30-bc2a-b2391bd42820 req-b3bc7283-446f-4d47-a83e-4cb029f99936 service nova] Creating event network-vif-plugged:b7885763-79d0-44c2-bc9d-4a434792584a for instance 5e03807e-942b-4155-835b-b1c86f5b80f5 on user Apr 17 10:39:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-470193b5-46b6-4d30-bc2a-b2391bd42820 req-b3bc7283-446f-4d47-a83e-4cb029f99936 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029806 Apr 17 10:39:11 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 102/330] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:39:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:39:17 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-39db14dd-9f3b-454c-89de-454056a9fa30 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:39:17 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-39db14dd-9f3b-454c-89de-454056a9fa30 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:39:17 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:39:17 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:39:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-39db14dd-9f3b-454c-89de-454056a9fa30 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-39db14dd-9f3b-454c-89de-454056a9fa30 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-39db14dd-9f3b-454c-89de-454056a9fa30 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-39db14dd-9f3b-454c-89de-454056a9fa30 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-39db14dd-9f3b-454c-89de-454056a9fa30 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-39db14dd-9f3b-454c-89de-454056a9fa30 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:18 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-39db14dd-9f3b-454c-89de-454056a9fa30 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:39:18 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-39db14dd-9f3b-454c-89de-454056a9fa30 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:39:18 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-39db14dd-9f3b-454c-89de-454056a9fa30 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:39:18 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-39db14dd-9f3b-454c-89de-454056a9fa30 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d" status: 200 len: 1778 microversion: 2.20 time: 0.698005 Apr 17 10:39:18 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 116/331] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:39:17 2023] GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d => generated 1778 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:39:21 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:39:21 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:39:21 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:39:21 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-03c4c59e-1eb5-433b-b9da-d0bcbb524436 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:39:21 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-03c4c59e-1eb5-433b-b9da-d0bcbb524436 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:39:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-03c4c59e-1eb5-433b-b9da-d0bcbb524436 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-03c4c59e-1eb5-433b-b9da-d0bcbb524436 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-03c4c59e-1eb5-433b-b9da-d0bcbb524436 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-03c4c59e-1eb5-433b-b9da-d0bcbb524436 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-03c4c59e-1eb5-433b-b9da-d0bcbb524436 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-03c4c59e-1eb5-433b-b9da-d0bcbb524436 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:21 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-03c4c59e-1eb5-433b-b9da-d0bcbb524436 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69d4d16a4bc479ba2a8a80f359135f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33eedb851ee244768016f5bf203d2f9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:39:21 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-03c4c59e-1eb5-433b-b9da-d0bcbb524436 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" status: 200 len: 1547 microversion: 2.1 time: 0.688999 Apr 17 10:39:21 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 114/332] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:39:21 2023] GET /compute/v2.1/servers/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf => generated 1547 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:39:22 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:39:22 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:39:22 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-0bc02303-db78-4b39-b878-bf8cd72196a1 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:39:22 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-0bc02303-db78-4b39-b878-bf8cd72196a1 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:39:22 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-0bc02303-db78-4b39-b878-bf8cd72196a1 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:22 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-0bc02303-db78-4b39-b878-bf8cd72196a1 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:22 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-0bc02303-db78-4b39-b878-bf8cd72196a1 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:22 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-0bc02303-db78-4b39-b878-bf8cd72196a1 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:22 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-0bc02303-db78-4b39-b878-bf8cd72196a1 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:22 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-0bc02303-db78-4b39-b878-bf8cd72196a1 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:22 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-0bc02303-db78-4b39-b878-bf8cd72196a1 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9862432f87f4500a46f32a0b27d54d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a17ec3e1b314acbb701f2d2d27d0560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:39:22 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-0bc02303-db78-4b39-b878-bf8cd72196a1 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99" status: 200 len: 1698 microversion: 2.1 time: 0.352802 Apr 17 10:39:22 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 103/333] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:39:22 2023] GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99 => generated 1698 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:39:26 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-f4803fb2-ce29-4d47-af0e-6c30fa832b2d tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] Action: 'create', calling method: .version_select at 0x7fc55a9072e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-253892749", "metadata": {"Type": "work"}}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:39:26 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-f4803fb2-ce29-4d47-af0e-6c30fa832b2d tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] Request method failure captured: Apr 17 10:39:26 user devstack@n-api.service[72745]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 17 10:39:26 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:39:26 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:39:26 user devstack@n-api.service[72745]: Connection: close Apr 17 10:39:26 user devstack@n-api.service[72745]: Content-Length: 121 Apr 17 10:39:26 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:39:26 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:39:26 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:39:26 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSHeJi1Rif8pE1R_QnQUeumP9y7K5XC1yuaO_DlbdNPyL0UhwEkcGL70Seh_3HdRkfE74rf_xfSa0YxDqJrSeNnE86NZB3ieDzT3HhlQk0ZmMU7y8HpRFJHDw6LilObQ1lEXfEpbB5QXBRxHZQXCgfJKx4rcMt9lejwrRM7cfvXHdoQ Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Project-Id: 83baa6891ddb48e5b59532e714ee2f73 Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Project-Name: tempest-VolumesNegativeTest-1811808282 Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83baa6891ddb48e5b59532e714ee2f73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83baa6891ddb48e5b59532e714ee2f73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/83baa6891ddb48e5b59532e714ee2f73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Tenant: tempest-VolumesNegativeTest-1811808282 Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Tenant-Id: 83baa6891ddb48e5b59532e714ee2f73 Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-VolumesNegativeTest-1811808282 Apr 17 10:39:26 user devstack@n-api.service[72745]: X-User: tempest-VolumesNegativeTest-1811808282-project-member Apr 17 10:39:26 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:39:26 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:39:26 user devstack@n-api.service[72745]: X-User-Id: 2c589c41d8344a8ba046a378c15374cc Apr 17 10:39:26 user devstack@n-api.service[72745]: X-User-Name: tempest-VolumesNegativeTest-1811808282-project-member Apr 17 10:39:26 user devstack@n-api.service[72745]: Apr 17 10:39:26 user devstack@n-api.service[72745]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-253892749", "metadata": {"Type": "work"}}} Apr 17 10:39:26 user devstack@n-api.service[72745]: method: Apr 17 10:39:26 user devstack@n-api.service[72745]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 17 10:39:26 user devstack@n-api.service[72745]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-253892749', 'metadata': {'Type': 'work'}}}} Apr 17 10:39:26 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise error Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi '#$%' Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-f4803fb2-ce29-4d47-af0e-6c30fa832b2d tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:39:26 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-f4803fb2-ce29-4d47-af0e-6c30fa832b2d tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.117259 Apr 17 10:39:26 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 117/334] 10.0.0.210 () {64 vars in 1233 bytes} [Mon Apr 17 10:39:26 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 17 10:39:26 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-f8b6815a-98dc-4f16-87f6-e02d901c6c86 tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] Action: 'create', calling method: .version_select at 0x7fc55aaebeb0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-303560989", "metadata": {"Type": "work"}}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:39:26 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-f8b6815a-98dc-4f16-87f6-e02d901c6c86 tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] Request method failure captured: Apr 17 10:39:26 user devstack@n-api.service[72743]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 17 10:39:26 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:39:26 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:39:26 user devstack@n-api.service[72743]: Connection: close Apr 17 10:39:26 user devstack@n-api.service[72743]: Content-Length: 119 Apr 17 10:39:26 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:39:26 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:39:26 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:39:26 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSHeJi1Rif8pE1R_QnQUeumP9y7K5XC1yuaO_DlbdNPyL0UhwEkcGL70Seh_3HdRkfE74rf_xfSa0YxDqJrSeNnE86NZB3ieDzT3HhlQk0ZmMU7y8HpRFJHDw6LilObQ1lEXfEpbB5QXBRxHZQXCgfJKx4rcMt9lejwrRM7cfvXHdoQ Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Project-Id: 83baa6891ddb48e5b59532e714ee2f73 Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Project-Name: tempest-VolumesNegativeTest-1811808282 Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83baa6891ddb48e5b59532e714ee2f73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83baa6891ddb48e5b59532e714ee2f73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/83baa6891ddb48e5b59532e714ee2f73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Tenant: tempest-VolumesNegativeTest-1811808282 Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Tenant-Id: 83baa6891ddb48e5b59532e714ee2f73 Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-VolumesNegativeTest-1811808282 Apr 17 10:39:26 user devstack@n-api.service[72743]: X-User: tempest-VolumesNegativeTest-1811808282-project-member Apr 17 10:39:26 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:39:26 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:39:26 user devstack@n-api.service[72743]: X-User-Id: 2c589c41d8344a8ba046a378c15374cc Apr 17 10:39:26 user devstack@n-api.service[72743]: X-User-Name: tempest-VolumesNegativeTest-1811808282-project-member Apr 17 10:39:26 user devstack@n-api.service[72743]: Apr 17 10:39:26 user devstack@n-api.service[72743]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-303560989", "metadata": {"Type": "work"}}} Apr 17 10:39:26 user devstack@n-api.service[72743]: method: Apr 17 10:39:26 user devstack@n-api.service[72743]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 17 10:39:26 user devstack@n-api.service[72743]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-303560989', 'metadata': {'Type': 'work'}}}} Apr 17 10:39:26 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise error Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi '0' Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-f8b6815a-98dc-4f16-87f6-e02d901c6c86 tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:39:26 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-f8b6815a-98dc-4f16-87f6-e02d901c6c86 tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009856 Apr 17 10:39:26 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 115/335] 10.0.0.210 () {64 vars in 1233 bytes} [Mon Apr 17 10:39:26 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 17 10:39:26 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-825e71bc-4d5a-4381-8d14-8070fe99543e tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] Action: 'create', calling method: .version_select at 0x7fc55acd2c20>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1683879995", "metadata": {"Type": "work"}}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:39:26 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-825e71bc-4d5a-4381-8d14-8070fe99543e tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] Request method failure captured: Apr 17 10:39:26 user devstack@n-api.service[72744]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 17 10:39:26 user devstack@n-api.service[72744]: Accept: application/json Apr 17 10:39:26 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 10:39:26 user devstack@n-api.service[72744]: Connection: close Apr 17 10:39:26 user devstack@n-api.service[72744]: Content-Length: 119 Apr 17 10:39:26 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 10:39:26 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 10:39:26 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 10:39:26 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 10:39:26 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSHeJi1Rif8pE1R_QnQUeumP9y7K5XC1yuaO_DlbdNPyL0UhwEkcGL70Seh_3HdRkfE74rf_xfSa0YxDqJrSeNnE86NZB3ieDzT3HhlQk0ZmMU7y8HpRFJHDw6LilObQ1lEXfEpbB5QXBRxHZQXCgfJKx4rcMt9lejwrRM7cfvXHdoQ Apr 17 10:39:26 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 10:39:26 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 10:39:26 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 10:39:26 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 10:39:26 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 10:39:26 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 10:39:26 user devstack@n-api.service[72744]: X-Project-Id: 83baa6891ddb48e5b59532e714ee2f73 Apr 17 10:39:26 user devstack@n-api.service[72744]: X-Project-Name: tempest-VolumesNegativeTest-1811808282 Apr 17 10:39:26 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 10:39:26 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 10:39:26 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83baa6891ddb48e5b59532e714ee2f73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83baa6891ddb48e5b59532e714ee2f73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/83baa6891ddb48e5b59532e714ee2f73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:39:26 user devstack@n-api.service[72744]: X-Tenant: tempest-VolumesNegativeTest-1811808282 Apr 17 10:39:26 user devstack@n-api.service[72744]: X-Tenant-Id: 83baa6891ddb48e5b59532e714ee2f73 Apr 17 10:39:26 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-VolumesNegativeTest-1811808282 Apr 17 10:39:26 user devstack@n-api.service[72744]: X-User: tempest-VolumesNegativeTest-1811808282-project-member Apr 17 10:39:26 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 10:39:26 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 10:39:26 user devstack@n-api.service[72744]: X-User-Id: 2c589c41d8344a8ba046a378c15374cc Apr 17 10:39:26 user devstack@n-api.service[72744]: X-User-Name: tempest-VolumesNegativeTest-1811808282-project-member Apr 17 10:39:26 user devstack@n-api.service[72744]: Apr 17 10:39:26 user devstack@n-api.service[72744]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1683879995", "metadata": {"Type": "work"}}} Apr 17 10:39:26 user devstack@n-api.service[72744]: method: Apr 17 10:39:26 user devstack@n-api.service[72744]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 17 10:39:26 user devstack@n-api.service[72744]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1683879995', 'metadata': {'Type': 'work'}}}} Apr 17 10:39:26 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise error Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi '' Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 17 10:39:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-825e71bc-4d5a-4381-8d14-8070fe99543e tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:39:26 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-825e71bc-4d5a-4381-8d14-8070fe99543e tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012151 Apr 17 10:39:26 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 104/336] 10.0.0.210 () {64 vars in 1233 bytes} [Mon Apr 17 10:39:26 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 17 10:39:26 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-d0d27bc6-d566-4956-bedb-f0e2a0603938 tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] Calling method '.version_select at 0x7fc55a9cd870>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:39:26 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-d0d27bc6-d566-4956-bedb-f0e2a0603938 tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] HTTP exception thrown: Volume tempest-invalid-596157776 could not be found. Apr 17 10:39:26 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-d0d27bc6-d566-4956-bedb-f0e2a0603938 tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] Request method failure captured: Apr 17 10:39:26 user devstack@n-api.service[72745]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-596157776 HTTP/1.1 Apr 17 10:39:26 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:39:26 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:39:26 user devstack@n-api.service[72745]: Connection: close Apr 17 10:39:26 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 10:39:26 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:39:26 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:39:26 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:39:26 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSHeJi1Rif8pE1R_QnQUeumP9y7K5XC1yuaO_DlbdNPyL0UhwEkcGL70Seh_3HdRkfE74rf_xfSa0YxDqJrSeNnE86NZB3ieDzT3HhlQk0ZmMU7y8HpRFJHDw6LilObQ1lEXfEpbB5QXBRxHZQXCgfJKx4rcMt9lejwrRM7cfvXHdoQ Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Project-Id: 83baa6891ddb48e5b59532e714ee2f73 Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Project-Name: tempest-VolumesNegativeTest-1811808282 Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83baa6891ddb48e5b59532e714ee2f73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83baa6891ddb48e5b59532e714ee2f73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/83baa6891ddb48e5b59532e714ee2f73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Tenant: tempest-VolumesNegativeTest-1811808282 Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Tenant-Id: 83baa6891ddb48e5b59532e714ee2f73 Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-VolumesNegativeTest-1811808282 Apr 17 10:39:26 user devstack@n-api.service[72745]: X-User: tempest-VolumesNegativeTest-1811808282-project-member Apr 17 10:39:26 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:39:26 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:39:26 user devstack@n-api.service[72745]: X-User-Id: 2c589c41d8344a8ba046a378c15374cc Apr 17 10:39:26 user devstack@n-api.service[72745]: X-User-Name: tempest-VolumesNegativeTest-1811808282-project-member Apr 17 10:39:26 user devstack@n-api.service[72745]: method: Apr 17 10:39:26 user devstack@n-api.service[72745]: exception: Volume tempest-invalid-596157776 could not be found. Apr 17 10:39:26 user devstack@n-api.service[72745]: action_args: {'id': 'tempest-invalid-596157776'} Apr 17 10:39:26 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-596157776 could not be found. (HTTP 404) (Request-ID: req-34825fa3-aad0-4e9e-8cae-95c1d55ded4c) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-596157776 could not be found. Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-596157776 could not be found. Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-596157776 could not be found. Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-d0d27bc6-d566-4956-bedb-f0e2a0603938 tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] Returning 404 to user: Volume tempest-invalid-596157776 could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:39:26 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-d0d27bc6-d566-4956-bedb-f0e2a0603938 tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-596157776" status: 404 len: 98 microversion: 2.1 time: 0.035032 Apr 17 10:39:26 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 118/337] 10.0.0.210 () {62 vars in 1292 bytes} [Mon Apr 17 10:39:26 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-596157776 => generated 98 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 17 10:39:26 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-ff375d84-6590-4db7-b6cc-3a956cf64bd2 tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003596 Apr 17 10:39:26 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 116/338] 10.0.0.210 () {62 vars in 1217 bytes} [Mon Apr 17 10:39:26 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 17 10:39:26 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-4de21acd-984d-4311-a0fb-f24134502949 tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005063 Apr 17 10:39:26 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 105/339] 10.0.0.210 () {62 vars in 1214 bytes} [Mon Apr 17 10:39:26 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 17 10:39:26 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-5309d94e-74f6-4c17-9e24-70538a8208ca tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] Calling method '.version_select at 0x7fc55a906830>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:39:26 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-5309d94e-74f6-4c17-9e24-70538a8208ca tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] HTTP exception thrown: Volume f8980073-f554-4560-b902-68029886d2ed could not be found. Apr 17 10:39:26 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-5309d94e-74f6-4c17-9e24-70538a8208ca tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] Request method failure captured: Apr 17 10:39:26 user devstack@n-api.service[72745]: request: DELETE /compute/v2.1/os-volumes/f8980073-f554-4560-b902-68029886d2ed HTTP/1.1 Apr 17 10:39:26 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:39:26 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:39:26 user devstack@n-api.service[72745]: Connection: close Apr 17 10:39:26 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 10:39:26 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:39:26 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:39:26 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:39:26 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSHeJi1Rif8pE1R_QnQUeumP9y7K5XC1yuaO_DlbdNPyL0UhwEkcGL70Seh_3HdRkfE74rf_xfSa0YxDqJrSeNnE86NZB3ieDzT3HhlQk0ZmMU7y8HpRFJHDw6LilObQ1lEXfEpbB5QXBRxHZQXCgfJKx4rcMt9lejwrRM7cfvXHdoQ Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Project-Id: 83baa6891ddb48e5b59532e714ee2f73 Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Project-Name: tempest-VolumesNegativeTest-1811808282 Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83baa6891ddb48e5b59532e714ee2f73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83baa6891ddb48e5b59532e714ee2f73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/83baa6891ddb48e5b59532e714ee2f73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Tenant: tempest-VolumesNegativeTest-1811808282 Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Tenant-Id: 83baa6891ddb48e5b59532e714ee2f73 Apr 17 10:39:26 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-VolumesNegativeTest-1811808282 Apr 17 10:39:26 user devstack@n-api.service[72745]: X-User: tempest-VolumesNegativeTest-1811808282-project-member Apr 17 10:39:26 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:39:26 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:39:26 user devstack@n-api.service[72745]: X-User-Id: 2c589c41d8344a8ba046a378c15374cc Apr 17 10:39:26 user devstack@n-api.service[72745]: X-User-Name: tempest-VolumesNegativeTest-1811808282-project-member Apr 17 10:39:26 user devstack@n-api.service[72745]: method: Apr 17 10:39:26 user devstack@n-api.service[72745]: exception: Volume f8980073-f554-4560-b902-68029886d2ed could not be found. Apr 17 10:39:26 user devstack@n-api.service[72745]: action_args: {'id': 'f8980073-f554-4560-b902-68029886d2ed'} Apr 17 10:39:26 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f8980073-f554-4560-b902-68029886d2ed could not be found. (HTTP 404) (Request-ID: req-7afeb1f1-1cd4-4ef8-8f07-c719e7712bf1) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f8980073-f554-4560-b902-68029886d2ed could not be found. Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f8980073-f554-4560-b902-68029886d2ed could not be found. Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f8980073-f554-4560-b902-68029886d2ed could not be found. Apr 17 10:39:26 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-5309d94e-74f6-4c17-9e24-70538a8208ca tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] Returning 404 to user: Volume f8980073-f554-4560-b902-68029886d2ed could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:39:26 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-5309d94e-74f6-4c17-9e24-70538a8208ca tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/f8980073-f554-4560-b902-68029886d2ed" status: 404 len: 109 microversion: 2.1 time: 0.035059 Apr 17 10:39:26 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 119/340] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 17 10:39:26 2023] DELETE /compute/v2.1/os-volumes/f8980073-f554-4560-b902-68029886d2ed => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:39:26 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-dc9df290-3927-4f73-abe9-daee9fc2d432 tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] Calling method '.version_select at 0x7fc55a9c0ca0>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:39:26 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-dc9df290-3927-4f73-abe9-daee9fc2d432 tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] HTTP exception thrown: Volume 32572c71-941a-46fa-b38d-eef3286678a5 could not be found. Apr 17 10:39:26 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-dc9df290-3927-4f73-abe9-daee9fc2d432 tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] Request method failure captured: Apr 17 10:39:26 user devstack@n-api.service[72743]: request: GET /compute/v2.1/os-volumes/32572c71-941a-46fa-b38d-eef3286678a5 HTTP/1.1 Apr 17 10:39:26 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:39:26 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:39:26 user devstack@n-api.service[72743]: Connection: close Apr 17 10:39:26 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:39:26 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:39:26 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:39:26 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:39:26 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSHeJi1Rif8pE1R_QnQUeumP9y7K5XC1yuaO_DlbdNPyL0UhwEkcGL70Seh_3HdRkfE74rf_xfSa0YxDqJrSeNnE86NZB3ieDzT3HhlQk0ZmMU7y8HpRFJHDw6LilObQ1lEXfEpbB5QXBRxHZQXCgfJKx4rcMt9lejwrRM7cfvXHdoQ Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Project-Id: 83baa6891ddb48e5b59532e714ee2f73 Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Project-Name: tempest-VolumesNegativeTest-1811808282 Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83baa6891ddb48e5b59532e714ee2f73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83baa6891ddb48e5b59532e714ee2f73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/83baa6891ddb48e5b59532e714ee2f73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Tenant: tempest-VolumesNegativeTest-1811808282 Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Tenant-Id: 83baa6891ddb48e5b59532e714ee2f73 Apr 17 10:39:26 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-VolumesNegativeTest-1811808282 Apr 17 10:39:26 user devstack@n-api.service[72743]: X-User: tempest-VolumesNegativeTest-1811808282-project-member Apr 17 10:39:26 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:39:26 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:39:26 user devstack@n-api.service[72743]: X-User-Id: 2c589c41d8344a8ba046a378c15374cc Apr 17 10:39:26 user devstack@n-api.service[72743]: X-User-Name: tempest-VolumesNegativeTest-1811808282-project-member Apr 17 10:39:26 user devstack@n-api.service[72743]: method: Apr 17 10:39:26 user devstack@n-api.service[72743]: exception: Volume 32572c71-941a-46fa-b38d-eef3286678a5 could not be found. Apr 17 10:39:26 user devstack@n-api.service[72743]: action_args: {'id': '32572c71-941a-46fa-b38d-eef3286678a5'} Apr 17 10:39:26 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 32572c71-941a-46fa-b38d-eef3286678a5 could not be found. (HTTP 404) (Request-ID: req-8cea558a-2dc5-4cd8-9a0b-49308a65e480) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 32572c71-941a-46fa-b38d-eef3286678a5 could not be found. Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 32572c71-941a-46fa-b38d-eef3286678a5 could not be found. Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 32572c71-941a-46fa-b38d-eef3286678a5 could not be found. Apr 17 10:39:26 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:39:26 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-dc9df290-3927-4f73-abe9-daee9fc2d432 tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] Returning 404 to user: Volume 32572c71-941a-46fa-b38d-eef3286678a5 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:39:26 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-dc9df290-3927-4f73-abe9-daee9fc2d432 tempest-VolumesNegativeTest-1811808282 tempest-VolumesNegativeTest-1811808282-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/32572c71-941a-46fa-b38d-eef3286678a5" status: 404 len: 109 microversion: 2.1 time: 0.044629 Apr 17 10:39:26 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 117/341] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 10:39:26 2023] GET /compute/v2.1/os-volumes/32572c71-941a-46fa-b38d-eef3286678a5 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:39:35 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:39:35 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:39:35 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-cff197cf-b2ca-4783-9bc5-a3661f1e03c1 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:39:35 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-cff197cf-b2ca-4783-9bc5-a3661f1e03c1 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:39:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cff197cf-b2ca-4783-9bc5-a3661f1e03c1 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cff197cf-b2ca-4783-9bc5-a3661f1e03c1 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cff197cf-b2ca-4783-9bc5-a3661f1e03c1 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cff197cf-b2ca-4783-9bc5-a3661f1e03c1 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cff197cf-b2ca-4783-9bc5-a3661f1e03c1 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cff197cf-b2ca-4783-9bc5-a3661f1e03c1 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:35 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-cff197cf-b2ca-4783-9bc5-a3661f1e03c1 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282298df65264595b5d7351066128b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850462faec874544bdc01dd14746d558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:39:35 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-cff197cf-b2ca-4783-9bc5-a3661f1e03c1 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" status: 200 len: 1701 microversion: 2.1 time: 0.291605 Apr 17 10:39:35 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 106/342] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:39:35 2023] GET /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 => generated 1701 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:39:42 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-1187e10c-d7cf-4dab-bf2c-ecbbbb80c737 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:39:42 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-1187e10c-d7cf-4dab-bf2c-ecbbbb80c737 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:39:42 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:39:42 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=16 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:39:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1187e10c-d7cf-4dab-bf2c-ecbbbb80c737 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1187e10c-d7cf-4dab-bf2c-ecbbbb80c737 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1187e10c-d7cf-4dab-bf2c-ecbbbb80c737 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1187e10c-d7cf-4dab-bf2c-ecbbbb80c737 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1187e10c-d7cf-4dab-bf2c-ecbbbb80c737 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1187e10c-d7cf-4dab-bf2c-ecbbbb80c737 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:42 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-1187e10c-d7cf-4dab-bf2c-ecbbbb80c737 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050024 Apr 17 10:39:42 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 120/343] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:39:42 2023] GET /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 17 10:39:47 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cd53fd2-fb00-4222-bb25-1f2fcd3b5224"}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:39:47 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:39:47 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:39:47 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:39:47 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:47 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:47 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:47 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:47 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:47 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:47 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-432bc6a9-461b-4ec7-a7c9-ddeb587813e2 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.594871 Apr 17 10:39:47 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 118/344] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Apr 17 10:39:47 2023] POST /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments => generated 194 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:39:50 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-07418f6e-89df-484c-ac23-35b787909da8 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:39:50 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-07418f6e-89df-484c-ac23-35b787909da8 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:39:50 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:39:50 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:39:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-07418f6e-89df-484c-ac23-35b787909da8 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-07418f6e-89df-484c-ac23-35b787909da8 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-07418f6e-89df-484c-ac23-35b787909da8 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-07418f6e-89df-484c-ac23-35b787909da8 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-07418f6e-89df-484c-ac23-35b787909da8 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-07418f6e-89df-484c-ac23-35b787909da8 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:50 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-07418f6e-89df-484c-ac23-35b787909da8 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/os-interface" status: 200 len: 282 microversion: 2.49 time: 0.195613 Apr 17 10:39:50 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 107/345] 10.0.0.210 () {64 vars in 1393 bytes} [Mon Apr 17 10:39:50 2023] GET /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/os-interface => generated 282 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 10:39:51 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-be58c794-be6f-4dc5-ba1b-1a916bbf7eb7 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:39:51 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-be58c794-be6f-4dc5-ba1b-1a916bbf7eb7 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:39:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-be58c794-be6f-4dc5-ba1b-1a916bbf7eb7 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-be58c794-be6f-4dc5-ba1b-1a916bbf7eb7 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-be58c794-be6f-4dc5-ba1b-1a916bbf7eb7 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-be58c794-be6f-4dc5-ba1b-1a916bbf7eb7 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-be58c794-be6f-4dc5-ba1b-1a916bbf7eb7 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-be58c794-be6f-4dc5-ba1b-1a916bbf7eb7 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:51 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-12b3eff2-a3fb-4c74-b02a-3cc1b1369a8a req-c0ece277-dce2-4080-ab28-4656455c57b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597", "tag": "3106e21d-664e-4c17-85be-f0a654c4eabc"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:39:51 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-12b3eff2-a3fb-4c74-b02a-3cc1b1369a8a req-c0ece277-dce2-4080-ab28-4656455c57b7 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:51 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-12b3eff2-a3fb-4c74-b02a-3cc1b1369a8a req-c0ece277-dce2-4080-ab28-4656455c57b7 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:51 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-12b3eff2-a3fb-4c74-b02a-3cc1b1369a8a req-c0ece277-dce2-4080-ab28-4656455c57b7 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:51 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-12b3eff2-a3fb-4c74-b02a-3cc1b1369a8a req-c0ece277-dce2-4080-ab28-4656455c57b7 service nova] Creating event network-changed:3106e21d-664e-4c17-85be-f0a654c4eabc for instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 on user Apr 17 10:39:51 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-12b3eff2-a3fb-4c74-b02a-3cc1b1369a8a req-c0ece277-dce2-4080-ab28-4656455c57b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166050 Apr 17 10:39:51 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 121/346] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:39:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:39:51 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-be58c794-be6f-4dc5-ba1b-1a916bbf7eb7 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab512fbd85694415a5f7af8b689814d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507228fb562e461e91a628829ce32d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:39:51 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-be58c794-be6f-4dc5-ba1b-1a916bbf7eb7 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab512fbd85694415a5f7af8b689814d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507228fb562e461e91a628829ce32d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:39:51 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-be58c794-be6f-4dc5-ba1b-1a916bbf7eb7 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab512fbd85694415a5f7af8b689814d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507228fb562e461e91a628829ce32d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:39:51 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-be58c794-be6f-4dc5-ba1b-1a916bbf7eb7 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" status: 200 len: 1627 microversion: 2.49 time: 0.189119 Apr 17 10:39:51 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 119/347] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:39:51 2023] GET /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 => generated 1627 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:39:51 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "80a7eb54-0ff4-48d7-a4dd-0daaf77a868f", "tag": "nic-tag"}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:39:51 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:39:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:54 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-17222124-2ce9-4cb9-97a2-bce4454b5115 req-d9b6fad3-3682-4b5e-aab4-906d77f2638e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597", "tag": "c7efbdb0-e5e1-498a-890a-2f670253e25e"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:39:54 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-17222124-2ce9-4cb9-97a2-bce4454b5115 req-d9b6fad3-3682-4b5e-aab4-906d77f2638e service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:54 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-17222124-2ce9-4cb9-97a2-bce4454b5115 req-d9b6fad3-3682-4b5e-aab4-906d77f2638e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:54 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-17222124-2ce9-4cb9-97a2-bce4454b5115 req-d9b6fad3-3682-4b5e-aab4-906d77f2638e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:54 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-17222124-2ce9-4cb9-97a2-bce4454b5115 req-d9b6fad3-3682-4b5e-aab4-906d77f2638e service nova] Creating event network-changed:c7efbdb0-e5e1-498a-890a-2f670253e25e for instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 on user Apr 17 10:39:54 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-17222124-2ce9-4cb9-97a2-bce4454b5115 req-d9b6fad3-3682-4b5e-aab4-906d77f2638e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040040 Apr 17 10:39:54 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 122/348] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:39:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:39:55 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-6c23a520-4dcb-4f74-8c46-567dbb748cf6 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:39:55 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-6c23a520-4dcb-4f74-8c46-567dbb748cf6 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:39:55 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6c23a520-4dcb-4f74-8c46-567dbb748cf6 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:55 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6c23a520-4dcb-4f74-8c46-567dbb748cf6 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:55 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6c23a520-4dcb-4f74-8c46-567dbb748cf6 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:55 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6c23a520-4dcb-4f74-8c46-567dbb748cf6 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:55 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6c23a520-4dcb-4f74-8c46-567dbb748cf6 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:55 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6c23a520-4dcb-4f74-8c46-567dbb748cf6 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:55 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-6c23a520-4dcb-4f74-8c46-567dbb748cf6 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e61a5e172c34636b183ef9c84b714d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b831c3b6c244dda1821583a6b8cd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:39:55 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-6c23a520-4dcb-4f74-8c46-567dbb748cf6 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e03807e-942b-4155-835b-b1c86f5b80f5" status: 200 len: 1494 microversion: 2.1 time: 0.301470 Apr 17 10:39:55 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 120/349] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:39:55 2023] GET /compute/v2.1/servers/5e03807e-942b-4155-835b-b1c86f5b80f5 => generated 1494 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:39:55 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-d661382e-2531-47b6-8849-c6f54be23218 req-9192cdb5-fa6e-41b7-aeb6-79645b75ce90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597", "name": "network-vif-plugged", "status": "completed", "tag": "c7efbdb0-e5e1-498a-890a-2f670253e25e"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:39:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-d661382e-2531-47b6-8849-c6f54be23218 req-9192cdb5-fa6e-41b7-aeb6-79645b75ce90 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-d661382e-2531-47b6-8849-c6f54be23218 req-9192cdb5-fa6e-41b7-aeb6-79645b75ce90 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-d661382e-2531-47b6-8849-c6f54be23218 req-9192cdb5-fa6e-41b7-aeb6-79645b75ce90 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:55 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-d661382e-2531-47b6-8849-c6f54be23218 req-9192cdb5-fa6e-41b7-aeb6-79645b75ce90 service nova] Creating event network-vif-plugged:c7efbdb0-e5e1-498a-890a-2f670253e25e for instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 on user Apr 17 10:39:55 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-d661382e-2531-47b6-8849-c6f54be23218 req-9192cdb5-fa6e-41b7-aeb6-79645b75ce90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105764 Apr 17 10:39:55 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 123/350] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:39:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:39:56 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:39:56 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:56 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:56 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:56 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:56 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:56 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:56 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-ee91d998-41af-4749-8a7b-69613c3f1b22 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/os-interface" status: 200 len: 283 microversion: 2.49 time: 4.413900 Apr 17 10:39:56 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 108/351] 10.0.0.210 () {66 vars in 1414 bytes} [Mon Apr 17 10:39:51 2023] POST /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/os-interface => generated 283 bytes in 4415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 10:39:56 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d64516c4-d9fa-4b15-9f2e-ed17e48f67ed", "tag": "volume-tag"}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:39:56 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:39:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:56 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-42bc4121-8cc0-4397-b821-1771701206f9 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.317862 Apr 17 10:39:56 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 121/352] 10.0.0.210 () {66 vars in 1441 bytes} [Mon Apr 17 10:39:56 2023] POST /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 10:39:57 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-a888c800-58b4-466c-933b-17a34333cc7c req-622402c1-0cdf-4abc-aaeb-33217645d607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597", "name": "network-vif-plugged", "status": "completed", "tag": "c7efbdb0-e5e1-498a-890a-2f670253e25e"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:39:58 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-a888c800-58b4-466c-933b-17a34333cc7c req-622402c1-0cdf-4abc-aaeb-33217645d607 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:58 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-a888c800-58b4-466c-933b-17a34333cc7c req-622402c1-0cdf-4abc-aaeb-33217645d607 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:58 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-a888c800-58b4-466c-933b-17a34333cc7c req-622402c1-0cdf-4abc-aaeb-33217645d607 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:58 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-a888c800-58b4-466c-933b-17a34333cc7c req-622402c1-0cdf-4abc-aaeb-33217645d607 service nova] Creating event network-vif-plugged:c7efbdb0-e5e1-498a-890a-2f670253e25e for instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 on user Apr 17 10:39:58 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-a888c800-58b4-466c-933b-17a34333cc7c req-622402c1-0cdf-4abc-aaeb-33217645d607 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034221 Apr 17 10:39:58 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 124/353] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:39:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:39:58 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:39:58 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:39:58 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:58 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:58 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:58 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:58 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:58 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:58 user devstack@n-api.service[72744]: DEBUG nova.objects.instance [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lazy-loading 'services' on Instance uuid 7792cf72-dc73-4201-9501-4515ce860735 {{(pid=72744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 10:39:59 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-f6e456e1-847b-4496-9af8-59e4c191d9e7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments/0cd53fd2-fb00-4222-bb25-1f2fcd3b5224" status: 202 len: 0 microversion: 2.1 time: 0.220695 Apr 17 10:39:59 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 109/354] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Apr 17 10:39:58 2023] DELETE /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments/0cd53fd2-fb00-4222-bb25-1f2fcd3b5224 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:39:59 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-cc7d6ea1-b152-4d08-9707-b62f91e06d49 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:39:59 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-cc7d6ea1-b152-4d08-9707-b62f91e06d49 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:39:59 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-cc7d6ea1-b152-4d08-9707-b62f91e06d49 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:59 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-cc7d6ea1-b152-4d08-9707-b62f91e06d49 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:59 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-cc7d6ea1-b152-4d08-9707-b62f91e06d49 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:59 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-cc7d6ea1-b152-4d08-9707-b62f91e06d49 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:39:59 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-cc7d6ea1-b152-4d08-9707-b62f91e06d49 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:39:59 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-cc7d6ea1-b152-4d08-9707-b62f91e06d49 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:39:59 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-cc7d6ea1-b152-4d08-9707-b62f91e06d49 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066608 Apr 17 10:39:59 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 122/355] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:39:59 2023] GET /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:40:04 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:40:04 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:04 user devstack@n-api.service[72745]: DEBUG nova.objects.instance [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lazy-loading 'services' on Instance uuid 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 {{(pid=72745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 10:40:04 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-9573448a-c3a7-45aa-9255-c14783d20456 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/os-volume_attachments/d64516c4-d9fa-4b15-9f2e-ed17e48f67ed" status: 202 len: 0 microversion: 2.49 time: 0.182489 Apr 17 10:40:04 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 125/356] 10.0.0.210 () {64 vars in 1534 bytes} [Mon Apr 17 10:40:04 2023] DELETE /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/os-volume_attachments/d64516c4-d9fa-4b15-9f2e-ed17e48f67ed => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:40:07 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:40:07 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:07 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-cc0d833d-e988-4c71-9295-5804ac3af31a tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/os-interface/c7efbdb0-e5e1-498a-890a-2f670253e25e" status: 202 len: 0 microversion: 2.49 time: 0.048498 Apr 17 10:40:07 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 110/357] 10.0.0.210 () {64 vars in 1507 bytes} [Mon Apr 17 10:40:07 2023] DELETE /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/os-interface/c7efbdb0-e5e1-498a-890a-2f670253e25e => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:40:07 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-e6bd2b1b-1a5e-4c6f-8a6c-b75d240e351f tempest-TaggedAttachmentsTest-1702295676 tempest-TaggedAttachmentsTest-1702295676-project-admin] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:40:07 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-e6bd2b1b-1a5e-4c6f-8a6c-b75d240e351f tempest-TaggedAttachmentsTest-1702295676 tempest-TaggedAttachmentsTest-1702295676-project-admin] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:07 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e6bd2b1b-1a5e-4c6f-8a6c-b75d240e351f tempest-TaggedAttachmentsTest-1702295676 tempest-TaggedAttachmentsTest-1702295676-project-admin] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:07 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e6bd2b1b-1a5e-4c6f-8a6c-b75d240e351f tempest-TaggedAttachmentsTest-1702295676 tempest-TaggedAttachmentsTest-1702295676-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:07 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e6bd2b1b-1a5e-4c6f-8a6c-b75d240e351f tempest-TaggedAttachmentsTest-1702295676 tempest-TaggedAttachmentsTest-1702295676-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:07 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e6bd2b1b-1a5e-4c6f-8a6c-b75d240e351f tempest-TaggedAttachmentsTest-1702295676 tempest-TaggedAttachmentsTest-1702295676-project-admin] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:07 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e6bd2b1b-1a5e-4c6f-8a6c-b75d240e351f tempest-TaggedAttachmentsTest-1702295676 tempest-TaggedAttachmentsTest-1702295676-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:07 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e6bd2b1b-1a5e-4c6f-8a6c-b75d240e351f tempest-TaggedAttachmentsTest-1702295676 tempest-TaggedAttachmentsTest-1702295676-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:07 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-e6bd2b1b-1a5e-4c6f-8a6c-b75d240e351f tempest-TaggedAttachmentsTest-1702295676 tempest-TaggedAttachmentsTest-1702295676-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/os-instance-actions/req-cc0d833d-e988-4c71-9295-5804ac3af31a" status: 200 len: 474 microversion: 2.49 time: 0.310494 Apr 17 10:40:07 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 123/358] 10.0.0.210 () {64 vars in 1537 bytes} [Mon Apr 17 10:40:07 2023] GET /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/os-instance-actions/req-cc0d833d-e988-4c71-9295-5804ac3af31a => generated 474 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 10:40:07 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-42c89709-7eb5-41de-8f3e-1f1113fb3184 req-9ee097b9-27d2-47de-b6be-3ffdeac0d062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597", "name": "network-vif-unplugged", "status": "completed", "tag": "c7efbdb0-e5e1-498a-890a-2f670253e25e"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:40:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-42c89709-7eb5-41de-8f3e-1f1113fb3184 req-9ee097b9-27d2-47de-b6be-3ffdeac0d062 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-42c89709-7eb5-41de-8f3e-1f1113fb3184 req-9ee097b9-27d2-47de-b6be-3ffdeac0d062 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-42c89709-7eb5-41de-8f3e-1f1113fb3184 req-9ee097b9-27d2-47de-b6be-3ffdeac0d062 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:07 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-42c89709-7eb5-41de-8f3e-1f1113fb3184 req-9ee097b9-27d2-47de-b6be-3ffdeac0d062 service nova] Creating event network-vif-unplugged:c7efbdb0-e5e1-498a-890a-2f670253e25e for instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 on user Apr 17 10:40:07 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-42c89709-7eb5-41de-8f3e-1f1113fb3184 req-9ee097b9-27d2-47de-b6be-3ffdeac0d062 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033161 Apr 17 10:40:07 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 126/359] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:40:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:40:07 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-492c92fa-263e-464f-b24c-fb436edf9265 req-232759f6-0b7d-44b1-bb0e-2c14093d9bfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597", "name": "network-vif-deleted", "tag": "c7efbdb0-e5e1-498a-890a-2f670253e25e"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:40:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-492c92fa-263e-464f-b24c-fb436edf9265 req-232759f6-0b7d-44b1-bb0e-2c14093d9bfb service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-492c92fa-263e-464f-b24c-fb436edf9265 req-232759f6-0b7d-44b1-bb0e-2c14093d9bfb service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-492c92fa-263e-464f-b24c-fb436edf9265 req-232759f6-0b7d-44b1-bb0e-2c14093d9bfb service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:07 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-492c92fa-263e-464f-b24c-fb436edf9265 req-232759f6-0b7d-44b1-bb0e-2c14093d9bfb service nova] Creating event network-vif-deleted:c7efbdb0-e5e1-498a-890a-2f670253e25e for instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 on user Apr 17 10:40:07 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-492c92fa-263e-464f-b24c-fb436edf9265 req-232759f6-0b7d-44b1-bb0e-2c14093d9bfb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030740 Apr 17 10:40:07 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 111/360] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:40:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:40:08 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:40:08 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:08 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=72743) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 17 10:40:09 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-3c3498fe-9306-4971-abd4-4dd725e3bc9d tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b0c707ac-b08f-4f18-8262-e1b79d7e17e1/action" status: 202 len: 0 microversion: 2.1 time: 0.122810 Apr 17 10:40:09 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 124/361] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 10:40:08 2023] POST /compute/v2.1/servers/b0c707ac-b08f-4f18-8262-e1b79d7e17e1/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:40:09 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "ce3ae2b5-2bb7-4d2a-8b63-e4367e4d36a7"}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:40:09 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-72b7a912-c042-41f4-a6e4-bfcc2958d837 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:40:09 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-72b7a912-c042-41f4-a6e4-bfcc2958d837 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:09 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-72b7a912-c042-41f4-a6e4-bfcc2958d837 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:09 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:09 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-72b7a912-c042-41f4-a6e4-bfcc2958d837 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:09 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-72b7a912-c042-41f4-a6e4-bfcc2958d837 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:09 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-72b7a912-c042-41f4-a6e4-bfcc2958d837 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:09 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-72b7a912-c042-41f4-a6e4-bfcc2958d837 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:09 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-72b7a912-c042-41f4-a6e4-bfcc2958d837 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:09 user devstack@n-api.service[72745]: DEBUG nova.objects.instance [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lazy-loading 'flavor' on Instance uuid 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab {{(pid=72745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 10:40:09 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-72b7a912-c042-41f4-a6e4-bfcc2958d837 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43c0aee7b05459d898e0dc2654262fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a793afb3e7045898c59a77975079d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:40:09 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-72b7a912-c042-41f4-a6e4-bfcc2958d837 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0c707ac-b08f-4f18-8262-e1b79d7e17e1" status: 200 len: 1505 microversion: 2.1 time: 0.224732 Apr 17 10:40:09 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 112/362] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:40:09 2023] GET /compute/v2.1/servers/b0c707ac-b08f-4f18-8262-e1b79d7e17e1 => generated 1505 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:40:09 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-baef7aa8-ee6e-421a-98ac-ebc461ca05ad tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab/action" status: 200 len: 29 microversion: 2.87 time: 0.505916 Apr 17 10:40:09 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 127/363] 10.0.0.210 () {66 vars in 1396 bytes} [Mon Apr 17 10:40:09 2023] POST /compute/v2.1/servers/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab/action => generated 29 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:40:09 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b69f6264-0665-4a7d-a1d8-e4f369ea02b1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:40:09 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-b69f6264-0665-4a7d-a1d8-e4f369ea02b1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:09 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b69f6264-0665-4a7d-a1d8-e4f369ea02b1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:09 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b69f6264-0665-4a7d-a1d8-e4f369ea02b1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:09 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b69f6264-0665-4a7d-a1d8-e4f369ea02b1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:09 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b69f6264-0665-4a7d-a1d8-e4f369ea02b1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:09 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b69f6264-0665-4a7d-a1d8-e4f369ea02b1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:09 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b69f6264-0665-4a7d-a1d8-e4f369ea02b1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:09 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-3b499d0f-69a4-4777-a98d-1ef87a432263 req-35ebc1c7-7a3a-4778-bdf5-6bca8741ef1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597", "name": "network-vif-plugged", "status": "completed", "tag": "c7efbdb0-e5e1-498a-890a-2f670253e25e"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:40:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-3b499d0f-69a4-4777-a98d-1ef87a432263 req-35ebc1c7-7a3a-4778-bdf5-6bca8741ef1b service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-3b499d0f-69a4-4777-a98d-1ef87a432263 req-35ebc1c7-7a3a-4778-bdf5-6bca8741ef1b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-3b499d0f-69a4-4777-a98d-1ef87a432263 req-35ebc1c7-7a3a-4778-bdf5-6bca8741ef1b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:09 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-3b499d0f-69a4-4777-a98d-1ef87a432263 req-35ebc1c7-7a3a-4778-bdf5-6bca8741ef1b service nova] Creating event network-vif-plugged:c7efbdb0-e5e1-498a-890a-2f670253e25e for instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 on user Apr 17 10:40:09 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-3b499d0f-69a4-4777-a98d-1ef87a432263 req-35ebc1c7-7a3a-4778-bdf5-6bca8741ef1b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035252 Apr 17 10:40:09 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 113/364] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:40:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 10:40:09 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-b69f6264-0665-4a7d-a1d8-e4f369ea02b1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:40:09 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-b69f6264-0665-4a7d-a1d8-e4f369ea02b1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:40:09 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-b69f6264-0665-4a7d-a1d8-e4f369ea02b1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:40:09 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-b69f6264-0665-4a7d-a1d8-e4f369ea02b1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" status: 200 len: 1775 microversion: 2.87 time: 0.375615 Apr 17 10:40:09 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 125/365] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:40:09 2023] GET /compute/v2.1/servers/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab => generated 1775 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:40:10 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-5a910f7a-73e3-4442-9d01-d14e6f87f228 req-89de9fde-f950-4dcb-90e1-8353cd10fd5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab", "name": "network-vif-unplugged", "status": "completed", "tag": "2acfe658-2dce-4086-b24a-ef0b4c3714f8"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:40:10 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-5a910f7a-73e3-4442-9d01-d14e6f87f228 req-89de9fde-f950-4dcb-90e1-8353cd10fd5c service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:10 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-5a910f7a-73e3-4442-9d01-d14e6f87f228 req-89de9fde-f950-4dcb-90e1-8353cd10fd5c service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:10 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-5a910f7a-73e3-4442-9d01-d14e6f87f228 req-89de9fde-f950-4dcb-90e1-8353cd10fd5c service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:10 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-5a910f7a-73e3-4442-9d01-d14e6f87f228 req-89de9fde-f950-4dcb-90e1-8353cd10fd5c service nova] Creating event network-vif-unplugged:2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab on user Apr 17 10:40:10 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-5a910f7a-73e3-4442-9d01-d14e6f87f228 req-89de9fde-f950-4dcb-90e1-8353cd10fd5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085217 Apr 17 10:40:10 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 128/366] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:40:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:40:12 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab", "name": "network-vif-plugged", "status": "completed", "tag": "2acfe658-2dce-4086-b24a-ef0b4c3714f8"}, {"server_uuid": "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab", "name": "network-vif-plugged", "status": "completed", "tag": "2acfe658-2dce-4086-b24a-ef0b4c3714f8"}, {"server_uuid": "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab", "name": "network-vif-plugged", "status": "completed", "tag": "2acfe658-2dce-4086-b24a-ef0b4c3714f8"}, {"server_uuid": "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab", "name": "network-vif-unplugged", "status": "completed", "tag": "2acfe658-2dce-4086-b24a-ef0b4c3714f8"}, {"server_uuid": "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab", "name": "network-vif-plugged", "status": "completed", "tag": "2acfe658-2dce-4086-b24a-ef0b4c3714f8"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:40:12 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:12 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:12 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:12 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] Creating event network-vif-plugged:2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab on user Apr 17 10:40:12 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] Creating event network-vif-plugged:2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab on user Apr 17 10:40:12 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] Creating event network-vif-plugged:2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab on user Apr 17 10:40:12 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] Creating event network-vif-unplugged:2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab on user Apr 17 10:40:12 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] Creating event network-vif-plugged:2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab on user Apr 17 10:40:12 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-c28e2403-7d72-4984-bf4f-1070bc44e341 req-7dbadb25-11ad-45b4-b8da-5ed96cded2a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.129405 Apr 17 10:40:12 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 114/367] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:40:12 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:40:14 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-e928aab8-d2ed-4abb-9ff8-cba222a655c8 req-816c8029-e8d7-476c-94ea-9e3fb39376b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab", "name": "network-vif-plugged", "status": "completed", "tag": "2acfe658-2dce-4086-b24a-ef0b4c3714f8"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:40:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-e928aab8-d2ed-4abb-9ff8-cba222a655c8 req-816c8029-e8d7-476c-94ea-9e3fb39376b6 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-e928aab8-d2ed-4abb-9ff8-cba222a655c8 req-816c8029-e8d7-476c-94ea-9e3fb39376b6 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-e928aab8-d2ed-4abb-9ff8-cba222a655c8 req-816c8029-e8d7-476c-94ea-9e3fb39376b6 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:14 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-e928aab8-d2ed-4abb-9ff8-cba222a655c8 req-816c8029-e8d7-476c-94ea-9e3fb39376b6 service nova] Creating event network-vif-plugged:2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab on user Apr 17 10:40:14 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-e928aab8-d2ed-4abb-9ff8-cba222a655c8 req-816c8029-e8d7-476c-94ea-9e3fb39376b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040553 Apr 17 10:40:14 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 126/368] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:40:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:40:16 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-6a1a8844-1a1c-43ce-b00b-405be6350f3e req-a2307c06-0481-4e4b-a66a-2f7601d6a27a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab", "name": "network-vif-plugged", "status": "completed", "tag": "2acfe658-2dce-4086-b24a-ef0b4c3714f8"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:40:16 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=19 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:40:16 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-6a1a8844-1a1c-43ce-b00b-405be6350f3e req-a2307c06-0481-4e4b-a66a-2f7601d6a27a service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:16 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-6a1a8844-1a1c-43ce-b00b-405be6350f3e req-a2307c06-0481-4e4b-a66a-2f7601d6a27a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:16 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-6a1a8844-1a1c-43ce-b00b-405be6350f3e req-a2307c06-0481-4e4b-a66a-2f7601d6a27a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:16 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:40:16 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-6a1a8844-1a1c-43ce-b00b-405be6350f3e req-a2307c06-0481-4e4b-a66a-2f7601d6a27a service nova] Creating event network-vif-plugged:2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab on user Apr 17 10:40:16 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-6a1a8844-1a1c-43ce-b00b-405be6350f3e req-a2307c06-0481-4e4b-a66a-2f7601d6a27a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034218 Apr 17 10:40:16 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 129/369] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:40:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:40:18 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-5a8a23d8-ffb0-413c-a59c-707c03b03613 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:40:18 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-5a8a23d8-ffb0-413c-a59c-707c03b03613 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:18 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5a8a23d8-ffb0-413c-a59c-707c03b03613 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:18 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5a8a23d8-ffb0-413c-a59c-707c03b03613 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:18 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5a8a23d8-ffb0-413c-a59c-707c03b03613 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:18 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5a8a23d8-ffb0-413c-a59c-707c03b03613 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:18 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5a8a23d8-ffb0-413c-a59c-707c03b03613 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:18 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5a8a23d8-ffb0-413c-a59c-707c03b03613 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:18 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-5a8a23d8-ffb0-413c-a59c-707c03b03613 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d/os-volume_attachments/1e959d4f-1d94-402d-84d5-323e6a987d67" status: 200 len: 194 microversion: 2.20 time: 0.193278 Apr 17 10:40:18 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 115/370] 10.0.0.210 () {64 vars in 1531 bytes} [Mon Apr 17 10:40:18 2023] GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d/os-volume_attachments/1e959d4f-1d94-402d-84d5-323e6a987d67 => generated 194 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 10:40:18 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:40:18 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:18 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:40:18 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:18 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:18 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:18 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:18 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:18 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:18 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:40:18 user devstack@n-api.service[72743]: DEBUG nova.objects.instance [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lazy-loading 'services' on Instance uuid c4315753-415c-45cd-b06f-da1e3ccc6e4d {{(pid=72743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 10:40:18 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-fbac848d-216b-4049-879a-1bacda9c480f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d/os-volume_attachments/1e959d4f-1d94-402d-84d5-323e6a987d67" status: 202 len: 0 microversion: 2.20 time: 0.268668 Apr 17 10:40:18 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 127/371] 10.0.0.210 () {64 vars in 1534 bytes} [Mon Apr 17 10:40:18 2023] DELETE /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d/os-volume_attachments/1e959d4f-1d94-402d-84d5-323e6a987d67 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:40:18 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-420ba676-5090-474e-bd4b-548a427a325f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:40:18 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-420ba676-5090-474e-bd4b-548a427a325f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:18 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-420ba676-5090-474e-bd4b-548a427a325f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:18 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-420ba676-5090-474e-bd4b-548a427a325f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:18 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-420ba676-5090-474e-bd4b-548a427a325f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:18 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-420ba676-5090-474e-bd4b-548a427a325f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:18 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-420ba676-5090-474e-bd4b-548a427a325f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:18 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-420ba676-5090-474e-bd4b-548a427a325f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:18 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-420ba676-5090-474e-bd4b-548a427a325f tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058324 Apr 17 10:40:18 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 130/372] 10.0.0.210 () {64 vars in 1420 bytes} [Mon Apr 17 10:40:18 2023] GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 10:40:20 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-49d891c4-efc5-4d1b-b83b-890df6f43be5 req-dc50e20b-b57d-4576-bddc-454c5b6ef4d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c707ac-b08f-4f18-8262-e1b79d7e17e1", "tag": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:40:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-49d891c4-efc5-4d1b-b83b-890df6f43be5 req-dc50e20b-b57d-4576-bddc-454c5b6ef4d3 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-49d891c4-efc5-4d1b-b83b-890df6f43be5 req-dc50e20b-b57d-4576-bddc-454c5b6ef4d3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-49d891c4-efc5-4d1b-b83b-890df6f43be5 req-dc50e20b-b57d-4576-bddc-454c5b6ef4d3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:20 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-49d891c4-efc5-4d1b-b83b-890df6f43be5 req-dc50e20b-b57d-4576-bddc-454c5b6ef4d3 service nova] Creating event network-changed:90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 for instance b0c707ac-b08f-4f18-8262-e1b79d7e17e1 on user Apr 17 10:40:20 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-49d891c4-efc5-4d1b-b83b-890df6f43be5 req-dc50e20b-b57d-4576-bddc-454c5b6ef4d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033331 Apr 17 10:40:20 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 116/373] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:40:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:40:21 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-a1331bc4-373e-4e85-b3a4-e2d90f12d94c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:40:21 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-a1331bc4-373e-4e85-b3a4-e2d90f12d94c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a1331bc4-373e-4e85-b3a4-e2d90f12d94c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a1331bc4-373e-4e85-b3a4-e2d90f12d94c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a1331bc4-373e-4e85-b3a4-e2d90f12d94c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a1331bc4-373e-4e85-b3a4-e2d90f12d94c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a1331bc4-373e-4e85-b3a4-e2d90f12d94c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a1331bc4-373e-4e85-b3a4-e2d90f12d94c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:21 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-a1331bc4-373e-4e85-b3a4-e2d90f12d94c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.178858 Apr 17 10:40:21 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 128/374] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 17 10:40:21 2023] GET /compute/v2.1/servers/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/os-interface => generated 283 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:40:22 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-b9643d5f-bc12-4326-afe0-12aee17f2048 req-2180037a-08fc-4145-8f5d-a6fb712f4feb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf", "tag": "e66863ce-1b10-4701-9a7c-3940117a0237"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:40:22 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=23 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:40:22 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-b9643d5f-bc12-4326-afe0-12aee17f2048 req-2180037a-08fc-4145-8f5d-a6fb712f4feb service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:22 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-b9643d5f-bc12-4326-afe0-12aee17f2048 req-2180037a-08fc-4145-8f5d-a6fb712f4feb service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:22 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-b9643d5f-bc12-4326-afe0-12aee17f2048 req-2180037a-08fc-4145-8f5d-a6fb712f4feb service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:22 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=48,nova_cell1:INSERT=3 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:40:22 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-b9643d5f-bc12-4326-afe0-12aee17f2048 req-2180037a-08fc-4145-8f5d-a6fb712f4feb service nova] Creating event network-changed:e66863ce-1b10-4701-9a7c-3940117a0237 for instance 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf on user Apr 17 10:40:22 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-b9643d5f-bc12-4326-afe0-12aee17f2048 req-2180037a-08fc-4145-8f5d-a6fb712f4feb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045818 Apr 17 10:40:22 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 117/375] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:40:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:40:22 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:40:22 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:23 user devstack@n-api.service[72745]: DEBUG nova.objects.instance [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'services' on Instance uuid 59fd26de-d46e-4f41-91f6-090005a07d99 {{(pid=72745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 10:40:23 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-ecee717f-9bc9-4eb4-86c3-132dce826a13 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99/os-volume_attachments/77166f39-c9b1-499f-9ed8-1fdd6a0d81a1" status: 202 len: 0 microversion: 2.1 time: 0.332100 Apr 17 10:40:23 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 131/376] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Apr 17 10:40:22 2023] DELETE /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99/os-volume_attachments/77166f39-c9b1-499f-9ed8-1fdd6a0d81a1 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 17 10:40:25 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-103e6415-7e6c-4112-baaf-c90aabc27918 req-9f74d93d-55f1-4119-ab08-4fb8ba726482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c707ac-b08f-4f18-8262-e1b79d7e17e1", "name": "network-vif-plugged", "status": "completed", "tag": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3"}, {"server_uuid": "b0c707ac-b08f-4f18-8262-e1b79d7e17e1", "name": "network-vif-plugged", "status": "completed", "tag": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:40:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-103e6415-7e6c-4112-baaf-c90aabc27918 req-9f74d93d-55f1-4119-ab08-4fb8ba726482 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-103e6415-7e6c-4112-baaf-c90aabc27918 req-9f74d93d-55f1-4119-ab08-4fb8ba726482 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-103e6415-7e6c-4112-baaf-c90aabc27918 req-9f74d93d-55f1-4119-ab08-4fb8ba726482 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:25 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-103e6415-7e6c-4112-baaf-c90aabc27918 req-9f74d93d-55f1-4119-ab08-4fb8ba726482 service nova] Creating event network-vif-plugged:90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 for instance b0c707ac-b08f-4f18-8262-e1b79d7e17e1 on user Apr 17 10:40:25 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-103e6415-7e6c-4112-baaf-c90aabc27918 req-9f74d93d-55f1-4119-ab08-4fb8ba726482 service nova] Creating event network-vif-plugged:90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 for instance b0c707ac-b08f-4f18-8262-e1b79d7e17e1 on user Apr 17 10:40:25 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-103e6415-7e6c-4112-baaf-c90aabc27918 req-9f74d93d-55f1-4119-ab08-4fb8ba726482 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049845 Apr 17 10:40:25 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 129/377] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:40:25 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:40:26 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-2586f55c-6966-4b1c-a7a9-2e9b561cb80f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:40:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2586f55c-6966-4b1c-a7a9-2e9b561cb80f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2586f55c-6966-4b1c-a7a9-2e9b561cb80f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2586f55c-6966-4b1c-a7a9-2e9b561cb80f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:26 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-2586f55c-6966-4b1c-a7a9-2e9b561cb80f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Going to try to stop instance {{(pid=72744) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 17 10:40:26 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d55ca633-67ce-4587-8e19-e82124e3702d"}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:40:26 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:26 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-2586f55c-6966-4b1c-a7a9-2e9b561cb80f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "POST /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99/action" status: 202 len: 0 microversion: 2.1 time: 0.112448 Apr 17 10:40:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:26 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 118/378] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 10:40:26 2023] POST /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:40:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:26 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-401f95fc-e0a1-4d39-94e0-c9b5a9096905 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:40:26 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-401f95fc-e0a1-4d39-94e0-c9b5a9096905 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-401f95fc-e0a1-4d39-94e0-c9b5a9096905 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-401f95fc-e0a1-4d39-94e0-c9b5a9096905 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-401f95fc-e0a1-4d39-94e0-c9b5a9096905 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-401f95fc-e0a1-4d39-94e0-c9b5a9096905 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-401f95fc-e0a1-4d39-94e0-c9b5a9096905 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-401f95fc-e0a1-4d39-94e0-c9b5a9096905 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:26 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-401f95fc-e0a1-4d39-94e0-c9b5a9096905 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9862432f87f4500a46f32a0b27d54d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a17ec3e1b314acbb701f2d2d27d0560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:40:26 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-401f95fc-e0a1-4d39-94e0-c9b5a9096905 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99" status: 200 len: 1662 microversion: 2.1 time: 0.325161 Apr 17 10:40:26 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 130/379] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:40:26 2023] GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99 => generated 1662 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:40:27 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-86ad6d35-7dde-412e-98d4-82dba943ba1b tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] 10.0.0.210 "POST /compute/v2.1/servers/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.509408 Apr 17 10:40:27 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 132/380] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Apr 17 10:40:26 2023] POST /compute/v2.1/servers/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/os-volume_attachments => generated 194 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:40:27 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-f9ffe382-5722-4106-8b9b-28730ad7a76e req-8bbadc40-1699-4f58-9641-cb075ca1e6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59fd26de-d46e-4f41-91f6-090005a07d99", "name": "network-vif-unplugged", "status": "completed", "tag": "7124043d-665c-4a42-a041-b91ccc237b63"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:40:27 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-f9ffe382-5722-4106-8b9b-28730ad7a76e req-8bbadc40-1699-4f58-9641-cb075ca1e6f9 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:27 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-f9ffe382-5722-4106-8b9b-28730ad7a76e req-8bbadc40-1699-4f58-9641-cb075ca1e6f9 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:27 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-f9ffe382-5722-4106-8b9b-28730ad7a76e req-8bbadc40-1699-4f58-9641-cb075ca1e6f9 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:27 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-f9ffe382-5722-4106-8b9b-28730ad7a76e req-8bbadc40-1699-4f58-9641-cb075ca1e6f9 service nova] Creating event network-vif-unplugged:7124043d-665c-4a42-a041-b91ccc237b63 for instance 59fd26de-d46e-4f41-91f6-090005a07d99 on user Apr 17 10:40:27 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-f9ffe382-5722-4106-8b9b-28730ad7a76e req-8bbadc40-1699-4f58-9641-cb075ca1e6f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040781 Apr 17 10:40:27 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 119/381] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:40:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 10:40:29 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-54a9580d-a6eb-42ae-ae3b-f7c137df1b14 req-9282d5d5-e6a4-4faf-91db-70278c060794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59fd26de-d46e-4f41-91f6-090005a07d99", "name": "network-vif-plugged", "status": "completed", "tag": "7124043d-665c-4a42-a041-b91ccc237b63"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:40:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-54a9580d-a6eb-42ae-ae3b-f7c137df1b14 req-9282d5d5-e6a4-4faf-91db-70278c060794 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-54a9580d-a6eb-42ae-ae3b-f7c137df1b14 req-9282d5d5-e6a4-4faf-91db-70278c060794 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-54a9580d-a6eb-42ae-ae3b-f7c137df1b14 req-9282d5d5-e6a4-4faf-91db-70278c060794 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:29 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-54a9580d-a6eb-42ae-ae3b-f7c137df1b14 req-9282d5d5-e6a4-4faf-91db-70278c060794 service nova] Creating event network-vif-plugged:7124043d-665c-4a42-a041-b91ccc237b63 for instance 59fd26de-d46e-4f41-91f6-090005a07d99 on user Apr 17 10:40:29 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-54a9580d-a6eb-42ae-ae3b-f7c137df1b14 req-9282d5d5-e6a4-4faf-91db-70278c060794 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036313 Apr 17 10:40:29 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 131/382] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:40:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:40:34 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-6c7b6cc9-2b2e-441f-9d9b-16bc13e634e1 tempest-VolumesAdminNegativeTest-1956742641 tempest-VolumesAdminNegativeTest-1956742641-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "2bdce1de-acd1-4a69-806d-7e5811a56203"}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:40:34 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-6c7b6cc9-2b2e-441f-9d9b-16bc13e634e1 tempest-VolumesAdminNegativeTest-1956742641 tempest-VolumesAdminNegativeTest-1956742641-project-admin] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6c7b6cc9-2b2e-441f-9d9b-16bc13e634e1 tempest-VolumesAdminNegativeTest-1956742641 tempest-VolumesAdminNegativeTest-1956742641-project-admin] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6c7b6cc9-2b2e-441f-9d9b-16bc13e634e1 tempest-VolumesAdminNegativeTest-1956742641 tempest-VolumesAdminNegativeTest-1956742641-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6c7b6cc9-2b2e-441f-9d9b-16bc13e634e1 tempest-VolumesAdminNegativeTest-1956742641 tempest-VolumesAdminNegativeTest-1956742641-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6c7b6cc9-2b2e-441f-9d9b-16bc13e634e1 tempest-VolumesAdminNegativeTest-1956742641 tempest-VolumesAdminNegativeTest-1956742641-project-admin] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6c7b6cc9-2b2e-441f-9d9b-16bc13e634e1 tempest-VolumesAdminNegativeTest-1956742641 tempest-VolumesAdminNegativeTest-1956742641-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6c7b6cc9-2b2e-441f-9d9b-16bc13e634e1 tempest-VolumesAdminNegativeTest-1956742641 tempest-VolumesAdminNegativeTest-1956742641-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:35 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-6c7b6cc9-2b2e-441f-9d9b-16bc13e634e1 tempest-VolumesAdminNegativeTest-1956742641 tempest-VolumesAdminNegativeTest-1956742641-project-admin] HTTP exception thrown: Volume 2bdce1de-acd1-4a69-806d-7e5811a56203 could not be found. Apr 17 10:40:35 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-6c7b6cc9-2b2e-441f-9d9b-16bc13e634e1 tempest-VolumesAdminNegativeTest-1956742641 tempest-VolumesAdminNegativeTest-1956742641-project-admin] Request method failure captured: Apr 17 10:40:35 user devstack@n-api.service[72745]: request: PUT /compute/v2.1/servers/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/os-volume_attachments/d55ca633-67ce-4587-8e19-e82124e3702d HTTP/1.1 Apr 17 10:40:35 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:40:35 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:40:35 user devstack@n-api.service[72745]: Connection: close Apr 17 10:40:35 user devstack@n-api.service[72745]: Content-Length: 74 Apr 17 10:40:35 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:40:35 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:40:35 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:40:35 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:40:35 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSGjK1da_q820A0dVea_WrdtKkLMGLlpKZCLYOuwHXJepeNMW6jiGNP7jqOtVjOhKlSWOqUG91pcVkCvR1Y5ywNN7mUD2MJNAKWVcrx6BCk0-qg0eUdnO_2uhAovoCBKzcqAIqXE3C3KVpb7rGd2OBfdHwA5Cn0RLN9p8U9g9Sjuc7Y Apr 17 10:40:35 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:40:35 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:40:35 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:40:35 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:40:35 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:40:35 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:40:35 user devstack@n-api.service[72745]: X-Project-Id: 1cf7cd3e11504951a109190df64d30f9 Apr 17 10:40:35 user devstack@n-api.service[72745]: X-Project-Name: tempest-VolumesAdminNegativeTest-1956742641 Apr 17 10:40:35 user devstack@n-api.service[72745]: X-Role: admin,reader,member Apr 17 10:40:35 user devstack@n-api.service[72745]: X-Roles: admin,reader,member Apr 17 10:40:35 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1cf7cd3e11504951a109190df64d30f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1cf7cd3e11504951a109190df64d30f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1cf7cd3e11504951a109190df64d30f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:40:35 user devstack@n-api.service[72745]: X-Tenant: tempest-VolumesAdminNegativeTest-1956742641 Apr 17 10:40:35 user devstack@n-api.service[72745]: X-Tenant-Id: 1cf7cd3e11504951a109190df64d30f9 Apr 17 10:40:35 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1956742641 Apr 17 10:40:35 user devstack@n-api.service[72745]: X-User: tempest-VolumesAdminNegativeTest-1956742641-project-admin Apr 17 10:40:35 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:40:35 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:40:35 user devstack@n-api.service[72745]: X-User-Id: 6189d8f7847940e3835b1d5de52622e7 Apr 17 10:40:35 user devstack@n-api.service[72745]: X-User-Name: tempest-VolumesAdminNegativeTest-1956742641-project-admin Apr 17 10:40:35 user devstack@n-api.service[72745]: Apr 17 10:40:35 user devstack@n-api.service[72745]: {"volumeAttachment": {"volumeId": "2bdce1de-acd1-4a69-806d-7e5811a56203"}} Apr 17 10:40:35 user devstack@n-api.service[72745]: method: > Apr 17 10:40:35 user devstack@n-api.service[72745]: exception: Volume 2bdce1de-acd1-4a69-806d-7e5811a56203 could not be found. Apr 17 10:40:35 user devstack@n-api.service[72745]: action_args: {'server_id': '89bbf0b5-0314-4bc5-ba97-feae5a5a49bf', 'id': 'd55ca633-67ce-4587-8e19-e82124e3702d', 'body': {'volumeAttachment': {'volumeId': '2bdce1de-acd1-4a69-806d-7e5811a56203'}}} Apr 17 10:40:35 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2bdce1de-acd1-4a69-806d-7e5811a56203 could not be found. (HTTP 404) (Request-ID: req-338eb056-0b5c-4369-8281-055b6a33e64f) Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2bdce1de-acd1-4a69-806d-7e5811a56203 could not be found. Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 2bdce1de-acd1-4a69-806d-7e5811a56203 could not be found. Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2bdce1de-acd1-4a69-806d-7e5811a56203 could not be found. Apr 17 10:40:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:40:35 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-6c7b6cc9-2b2e-441f-9d9b-16bc13e634e1 tempest-VolumesAdminNegativeTest-1956742641 tempest-VolumesAdminNegativeTest-1956742641-project-admin] Returning 400 to user: Volume 2bdce1de-acd1-4a69-806d-7e5811a56203 could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:40:35 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-6c7b6cc9-2b2e-441f-9d9b-16bc13e634e1 tempest-VolumesAdminNegativeTest-1956742641 tempest-VolumesAdminNegativeTest-1956742641-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/os-volume_attachments/d55ca633-67ce-4587-8e19-e82124e3702d" status: 400 len: 107 microversion: 2.1 time: 0.322767 Apr 17 10:40:35 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 133/383] 10.0.0.210 () {64 vars in 1510 bytes} [Mon Apr 17 10:40:34 2023] PUT /compute/v2.1/servers/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/os-volume_attachments/d55ca633-67ce-4587-8e19-e82124e3702d => generated 107 bytes in 324 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 17 10:40:35 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:40:35 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:35 user devstack@n-api.service[72744]: DEBUG nova.objects.instance [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lazy-loading 'services' on Instance uuid 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf {{(pid=72744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 10:40:35 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-c1545104-57b5-4bc9-85e9-a4e731f5d994 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/os-volume_attachments/d55ca633-67ce-4587-8e19-e82124e3702d" status: 202 len: 0 microversion: 2.1 time: 0.165304 Apr 17 10:40:35 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 120/384] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Apr 17 10:40:35 2023] DELETE /compute/v2.1/servers/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/os-volume_attachments/d55ca633-67ce-4587-8e19-e82124e3702d => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:40:35 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-f967051b-204f-460a-89d9-7bdbd3c25afa tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:40:35 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-f967051b-204f-460a-89d9-7bdbd3c25afa tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f967051b-204f-460a-89d9-7bdbd3c25afa tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f967051b-204f-460a-89d9-7bdbd3c25afa tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f967051b-204f-460a-89d9-7bdbd3c25afa tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f967051b-204f-460a-89d9-7bdbd3c25afa tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f967051b-204f-460a-89d9-7bdbd3c25afa tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f967051b-204f-460a-89d9-7bdbd3c25afa tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:35 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-f967051b-204f-460a-89d9-7bdbd3c25afa tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051339 Apr 17 10:40:35 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 132/385] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:40:35 2023] GET /compute/v2.1/servers/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:40:35 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-4fcd7350-3240-491a-b22d-80aad438e302 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:40:35 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-4fcd7350-3240-491a-b22d-80aad438e302 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4fcd7350-3240-491a-b22d-80aad438e302 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4fcd7350-3240-491a-b22d-80aad438e302 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4fcd7350-3240-491a-b22d-80aad438e302 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4fcd7350-3240-491a-b22d-80aad438e302 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4fcd7350-3240-491a-b22d-80aad438e302 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4fcd7350-3240-491a-b22d-80aad438e302 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:35 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-4fcd7350-3240-491a-b22d-80aad438e302 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/action" status: 202 len: 0 microversion: 2.1 time: 0.226290 Apr 17 10:40:35 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 134/386] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 10:40:35 2023] POST /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:40:35 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-082afe8c-b47a-4ebb-bdd9-fbd873cf41ff tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:40:35 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-082afe8c-b47a-4ebb-bdd9-fbd873cf41ff tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-082afe8c-b47a-4ebb-bdd9-fbd873cf41ff tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-082afe8c-b47a-4ebb-bdd9-fbd873cf41ff tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-082afe8c-b47a-4ebb-bdd9-fbd873cf41ff tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-082afe8c-b47a-4ebb-bdd9-fbd873cf41ff tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-082afe8c-b47a-4ebb-bdd9-fbd873cf41ff tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-082afe8c-b47a-4ebb-bdd9-fbd873cf41ff tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:36 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-082afe8c-b47a-4ebb-bdd9-fbd873cf41ff tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.335665 Apr 17 10:40:36 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 121/387] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 17 10:40:35 2023] GET /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/os-interface => generated 282 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 10:40:36 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-de3374be-af67-4704-993c-18a41e67a650 req-972111a4-9a01-4767-8496-2848187b10ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4", "name": "network-vif-unplugged", "status": "completed", "tag": "f839dea5-4294-4842-bfa2-262351dabfb9"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:40:36 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-de3374be-af67-4704-993c-18a41e67a650 req-972111a4-9a01-4767-8496-2848187b10ba service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:36 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-de3374be-af67-4704-993c-18a41e67a650 req-972111a4-9a01-4767-8496-2848187b10ba service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:36 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-de3374be-af67-4704-993c-18a41e67a650 req-972111a4-9a01-4767-8496-2848187b10ba service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:36 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-de3374be-af67-4704-993c-18a41e67a650 req-972111a4-9a01-4767-8496-2848187b10ba service nova] Creating event network-vif-unplugged:f839dea5-4294-4842-bfa2-262351dabfb9 for instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 on user Apr 17 10:40:36 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-de3374be-af67-4704-993c-18a41e67a650 req-972111a4-9a01-4767-8496-2848187b10ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062372 Apr 17 10:40:36 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 133/388] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:40:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:40:37 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-3865bdbc-0ad4-418b-a55c-09f90ddd55d9 req-d7b69e32-833f-49f2-865f-996f4b9183cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4", "tag": "f839dea5-4294-4842-bfa2-262351dabfb9"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:40:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-3865bdbc-0ad4-418b-a55c-09f90ddd55d9 req-d7b69e32-833f-49f2-865f-996f4b9183cd service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-3865bdbc-0ad4-418b-a55c-09f90ddd55d9 req-d7b69e32-833f-49f2-865f-996f4b9183cd service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-3865bdbc-0ad4-418b-a55c-09f90ddd55d9 req-d7b69e32-833f-49f2-865f-996f4b9183cd service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:37 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-3865bdbc-0ad4-418b-a55c-09f90ddd55d9 req-d7b69e32-833f-49f2-865f-996f4b9183cd service nova] Creating event network-changed:f839dea5-4294-4842-bfa2-262351dabfb9 for instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 on user Apr 17 10:40:37 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-3865bdbc-0ad4-418b-a55c-09f90ddd55d9 req-d7b69e32-833f-49f2-865f-996f4b9183cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036565 Apr 17 10:40:37 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 135/389] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:40:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:40:39 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4", "name": "network-vif-plugged", "status": "completed", "tag": "f839dea5-4294-4842-bfa2-262351dabfb9"}, {"server_uuid": "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4", "name": "network-vif-plugged", "status": "completed", "tag": "f839dea5-4294-4842-bfa2-262351dabfb9"}, {"server_uuid": "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4", "name": "network-vif-plugged", "status": "completed", "tag": "f839dea5-4294-4842-bfa2-262351dabfb9"}, {"server_uuid": "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4", "name": "network-vif-unplugged", "status": "completed", "tag": "f839dea5-4294-4842-bfa2-262351dabfb9"}, {"server_uuid": "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4", "name": "network-vif-plugged", "status": "completed", "tag": "f839dea5-4294-4842-bfa2-262351dabfb9"}, {"server_uuid": "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4", "name": "network-vif-plugged", "status": "completed", "tag": "f839dea5-4294-4842-bfa2-262351dabfb9"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:40:39 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:39 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:39 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:39 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Creating event network-vif-plugged:f839dea5-4294-4842-bfa2-262351dabfb9 for instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 on user Apr 17 10:40:39 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Creating event network-vif-plugged:f839dea5-4294-4842-bfa2-262351dabfb9 for instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 on user Apr 17 10:40:39 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Creating event network-vif-plugged:f839dea5-4294-4842-bfa2-262351dabfb9 for instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 on user Apr 17 10:40:39 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Creating event network-vif-unplugged:f839dea5-4294-4842-bfa2-262351dabfb9 for instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 on user Apr 17 10:40:39 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Creating event network-vif-plugged:f839dea5-4294-4842-bfa2-262351dabfb9 for instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 on user Apr 17 10:40:39 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] Creating event network-vif-plugged:f839dea5-4294-4842-bfa2-262351dabfb9 for instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 on user Apr 17 10:40:39 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-3d10c8a4-f80b-4fba-9371-34ebab248d7a req-fdbfbb9d-eecc-48c7-bf76-bb921ad02d54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.044503 Apr 17 10:40:39 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 122/390] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:40:39 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 17 10:40:39 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-eb302731-1ac9-4f77-950d-8f10826388ab req-17aee74c-c0dc-4da2-ba49-ad99d115aa1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4", "tag": "f839dea5-4294-4842-bfa2-262351dabfb9"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:40:39 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-eb302731-1ac9-4f77-950d-8f10826388ab req-17aee74c-c0dc-4da2-ba49-ad99d115aa1c service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:39 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-eb302731-1ac9-4f77-950d-8f10826388ab req-17aee74c-c0dc-4da2-ba49-ad99d115aa1c service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:39 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-eb302731-1ac9-4f77-950d-8f10826388ab req-17aee74c-c0dc-4da2-ba49-ad99d115aa1c service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:39 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-eb302731-1ac9-4f77-950d-8f10826388ab req-17aee74c-c0dc-4da2-ba49-ad99d115aa1c service nova] Creating event network-changed:f839dea5-4294-4842-bfa2-262351dabfb9 for instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 on user Apr 17 10:40:39 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-eb302731-1ac9-4f77-950d-8f10826388ab req-17aee74c-c0dc-4da2-ba49-ad99d115aa1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042769 Apr 17 10:40:39 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 134/391] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:40:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:40:41 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-32fd3fe0-5aec-4ae6-aaf8-e41ee29f0afc req-da94ea59-d10b-4e83-8404-804b22c82b15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4", "name": "network-vif-plugged", "status": "completed", "tag": "f839dea5-4294-4842-bfa2-262351dabfb9"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:40:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-32fd3fe0-5aec-4ae6-aaf8-e41ee29f0afc req-da94ea59-d10b-4e83-8404-804b22c82b15 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-32fd3fe0-5aec-4ae6-aaf8-e41ee29f0afc req-da94ea59-d10b-4e83-8404-804b22c82b15 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-32fd3fe0-5aec-4ae6-aaf8-e41ee29f0afc req-da94ea59-d10b-4e83-8404-804b22c82b15 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:41 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-32fd3fe0-5aec-4ae6-aaf8-e41ee29f0afc req-da94ea59-d10b-4e83-8404-804b22c82b15 service nova] Creating event network-vif-plugged:f839dea5-4294-4842-bfa2-262351dabfb9 for instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 on user Apr 17 10:40:41 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-32fd3fe0-5aec-4ae6-aaf8-e41ee29f0afc req-da94ea59-d10b-4e83-8404-804b22c82b15 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031947 Apr 17 10:40:41 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 136/392] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:40:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:40:49 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=11 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:40:49 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:40:49 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-881b5c20-b214-4e22-8d1c-20756d098365 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:40:49 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-881b5c20-b214-4e22-8d1c-20756d098365 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-881b5c20-b214-4e22-8d1c-20756d098365 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-881b5c20-b214-4e22-8d1c-20756d098365 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-881b5c20-b214-4e22-8d1c-20756d098365 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-881b5c20-b214-4e22-8d1c-20756d098365 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-881b5c20-b214-4e22-8d1c-20756d098365 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-881b5c20-b214-4e22-8d1c-20756d098365 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:49 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-881b5c20-b214-4e22-8d1c-20756d098365 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.268392 Apr 17 10:40:49 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 123/393] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:40:49 2023] GET /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments => generated 25 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 17 10:40:53 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b225ba1-7dd8-420b-8e44-cae7e5b7a53b"}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:40:53 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:53 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=15 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:40:53 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=32,nova_cell1:INSERT=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:40:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:53 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-c0430b00-611b-4b64-9019-cd52a8a2c8f8 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320802 Apr 17 10:40:53 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 135/394] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Apr 17 10:40:53 2023] POST /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:40:55 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-452716688", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "networks": [{"uuid": "d72c00d6-55cf-4a6c-9d41-f5bbe89865d8"}]}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:40:55 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=15 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:40:55 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:40:55 user devstack@n-api.service[72745]: DEBUG nova.network.neutron [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] validate_networks() for [('d72c00d6-55cf-4a6c-9d41-f5bbe89865d8', None, None, None, None, None)] {{(pid=72745) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:40:56 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Flavor limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:40:56 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Image limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:40:56 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Flavor pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:40:56 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Image pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:40:56 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:40:56 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:56 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:56 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:56 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:56 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:56 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:56 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Getting quotas for project a8b831c3b6c244dda1821583a6b8cd08. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:40:56 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Getting quotas for user 1e61a5e172c34636b183ef9c84b714d8 and project a8b831c3b6c244dda1821583a6b8cd08. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:40:56 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Going to run 1 instances... {{(pid=72745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:40:56 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:40:56 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-5df249ff-1f50-4968-bc63-12399829dd50 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.098721 Apr 17 10:40:56 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 137/395] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:40:55 2023] POST /compute/v2.1/servers => generated 378 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 10:40:56 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-af2acc50-a725-4890-9eb4-3c5049fdb283 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:40:56 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-af2acc50-a725-4890-9eb4-3c5049fdb283 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:56 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-af2acc50-a725-4890-9eb4-3c5049fdb283 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e61a5e172c34636b183ef9c84b714d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b831c3b6c244dda1821583a6b8cd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:40:56 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-af2acc50-a725-4890-9eb4-3c5049fdb283 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0a9753b-207e-4c23-9fea-f7dc89a5edf7" status: 200 len: 1210 microversion: 2.1 time: 0.070406 Apr 17 10:40:56 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 124/396] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:40:56 2023] GET /compute/v2.1/servers/b0a9753b-207e-4c23-9fea-f7dc89a5edf7 => generated 1210 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 17 10:40:57 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b728417f-2d29-4850-9fb1-0cc511c49359 tempest-TaggedAttachmentsTest-1702295676 tempest-TaggedAttachmentsTest-1702295676-project-admin] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:40:57 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-b728417f-2d29-4850-9fb1-0cc511c49359 tempest-TaggedAttachmentsTest-1702295676 tempest-TaggedAttachmentsTest-1702295676-project-admin] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:57 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b728417f-2d29-4850-9fb1-0cc511c49359 tempest-TaggedAttachmentsTest-1702295676 tempest-TaggedAttachmentsTest-1702295676-project-admin] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:57 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b728417f-2d29-4850-9fb1-0cc511c49359 tempest-TaggedAttachmentsTest-1702295676 tempest-TaggedAttachmentsTest-1702295676-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:57 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b728417f-2d29-4850-9fb1-0cc511c49359 tempest-TaggedAttachmentsTest-1702295676 tempest-TaggedAttachmentsTest-1702295676-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:57 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b728417f-2d29-4850-9fb1-0cc511c49359 tempest-TaggedAttachmentsTest-1702295676 tempest-TaggedAttachmentsTest-1702295676-project-admin] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:57 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b728417f-2d29-4850-9fb1-0cc511c49359 tempest-TaggedAttachmentsTest-1702295676 tempest-TaggedAttachmentsTest-1702295676-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:57 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b728417f-2d29-4850-9fb1-0cc511c49359 tempest-TaggedAttachmentsTest-1702295676 tempest-TaggedAttachmentsTest-1702295676-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:57 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-b728417f-2d29-4850-9fb1-0cc511c49359 tempest-TaggedAttachmentsTest-1702295676 tempest-TaggedAttachmentsTest-1702295676-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/os-instance-actions/req-cc0d833d-e988-4c71-9295-5804ac3af31a" status: 200 len: 503 microversion: 2.49 time: 0.044533 Apr 17 10:40:57 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 136/397] 10.0.0.210 () {64 vars in 1537 bytes} [Mon Apr 17 10:40:57 2023] GET /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/os-instance-actions/req-cc0d833d-e988-4c71-9295-5804ac3af31a => generated 503 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 10:40:57 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-4ccaa63e-68d2-4358-be16-d7168c5057e7 tempest-TaggedAttachmentsTest-1702295676 tempest-TaggedAttachmentsTest-1702295676-project-admin] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:40:57 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-4ccaa63e-68d2-4358-be16-d7168c5057e7 tempest-TaggedAttachmentsTest-1702295676 tempest-TaggedAttachmentsTest-1702295676-project-admin] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4ccaa63e-68d2-4358-be16-d7168c5057e7 tempest-TaggedAttachmentsTest-1702295676 tempest-TaggedAttachmentsTest-1702295676-project-admin] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4ccaa63e-68d2-4358-be16-d7168c5057e7 tempest-TaggedAttachmentsTest-1702295676 tempest-TaggedAttachmentsTest-1702295676-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4ccaa63e-68d2-4358-be16-d7168c5057e7 tempest-TaggedAttachmentsTest-1702295676 tempest-TaggedAttachmentsTest-1702295676-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4ccaa63e-68d2-4358-be16-d7168c5057e7 tempest-TaggedAttachmentsTest-1702295676 tempest-TaggedAttachmentsTest-1702295676-project-admin] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4ccaa63e-68d2-4358-be16-d7168c5057e7 tempest-TaggedAttachmentsTest-1702295676 tempest-TaggedAttachmentsTest-1702295676-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4ccaa63e-68d2-4358-be16-d7168c5057e7 tempest-TaggedAttachmentsTest-1702295676 tempest-TaggedAttachmentsTest-1702295676-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:57 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-4ccaa63e-68d2-4358-be16-d7168c5057e7 tempest-TaggedAttachmentsTest-1702295676 tempest-TaggedAttachmentsTest-1702295676-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/os-instance-actions/req-cc0d833d-e988-4c71-9295-5804ac3af31a" status: 200 len: 503 microversion: 2.49 time: 0.099790 Apr 17 10:40:57 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 138/398] 10.0.0.210 () {64 vars in 1537 bytes} [Mon Apr 17 10:40:57 2023] GET /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/os-instance-actions/req-cc0d833d-e988-4c71-9295-5804ac3af31a => generated 503 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 10:40:57 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-2247d21f-895a-4da2-a395-ea670c165a66 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:40:57 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-2247d21f-895a-4da2-a395-ea670c165a66 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2247d21f-895a-4da2-a395-ea670c165a66 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2247d21f-895a-4da2-a395-ea670c165a66 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2247d21f-895a-4da2-a395-ea670c165a66 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2247d21f-895a-4da2-a395-ea670c165a66 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2247d21f-895a-4da2-a395-ea670c165a66 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2247d21f-895a-4da2-a395-ea670c165a66 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:57 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-2247d21f-895a-4da2-a395-ea670c165a66 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.046114 Apr 17 10:40:57 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 125/399] 10.0.0.210 () {64 vars in 1420 bytes} [Mon Apr 17 10:40:57 2023] GET /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:40:57 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:40:57 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:57 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:57 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:57 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:57 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:57 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:57 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:57 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Going to try to terminate instance {{(pid=72743) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:40:57 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-d31c96ea-50d9-47d3-8d17-351b8a063fa0 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" status: 204 len: 0 microversion: 2.49 time: 0.110567 Apr 17 10:40:57 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 137/400] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 17 10:40:57 2023] DELETE /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 17 10:40:57 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-5baba6ac-ee59-4714-be0c-f0dc5c4b070e tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:40:57 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-5baba6ac-ee59-4714-be0c-f0dc5c4b070e tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5baba6ac-ee59-4714-be0c-f0dc5c4b070e tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5baba6ac-ee59-4714-be0c-f0dc5c4b070e tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5baba6ac-ee59-4714-be0c-f0dc5c4b070e tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5baba6ac-ee59-4714-be0c-f0dc5c4b070e tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5baba6ac-ee59-4714-be0c-f0dc5c4b070e tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5baba6ac-ee59-4714-be0c-f0dc5c4b070e tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:58 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-5baba6ac-ee59-4714-be0c-f0dc5c4b070e tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab512fbd85694415a5f7af8b689814d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507228fb562e461e91a628829ce32d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:40:58 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-5baba6ac-ee59-4714-be0c-f0dc5c4b070e tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab512fbd85694415a5f7af8b689814d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507228fb562e461e91a628829ce32d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:40:58 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-5baba6ac-ee59-4714-be0c-f0dc5c4b070e tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab512fbd85694415a5f7af8b689814d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507228fb562e461e91a628829ce32d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:40:58 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-5baba6ac-ee59-4714-be0c-f0dc5c4b070e tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" status: 200 len: 1751 microversion: 2.49 time: 0.290030 Apr 17 10:40:58 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 139/401] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:40:57 2023] GET /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 => generated 1751 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:40:58 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-72880b72-83a2-4fbe-a2f7-4475a4108933 req-ec980a16-3f76-4b7c-aaa1-85ba8b12776a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597", "name": "network-vif-unplugged", "status": "completed", "tag": "3106e21d-664e-4c17-85be-f0a654c4eabc"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:40:58 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-72880b72-83a2-4fbe-a2f7-4475a4108933 req-ec980a16-3f76-4b7c-aaa1-85ba8b12776a service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:58 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-72880b72-83a2-4fbe-a2f7-4475a4108933 req-ec980a16-3f76-4b7c-aaa1-85ba8b12776a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:58 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-72880b72-83a2-4fbe-a2f7-4475a4108933 req-ec980a16-3f76-4b7c-aaa1-85ba8b12776a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:58 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-72880b72-83a2-4fbe-a2f7-4475a4108933 req-ec980a16-3f76-4b7c-aaa1-85ba8b12776a service nova] Creating event network-vif-unplugged:3106e21d-664e-4c17-85be-f0a654c4eabc for instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 on user Apr 17 10:40:58 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-72880b72-83a2-4fbe-a2f7-4475a4108933 req-ec980a16-3f76-4b7c-aaa1-85ba8b12776a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044030 Apr 17 10:40:58 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 126/402] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:40:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:40:59 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-a21139f6-ee6a-4a7e-bab7-1f2eeca951c1 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:40:59 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-a21139f6-ee6a-4a7e-bab7-1f2eeca951c1 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:40:59 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a21139f6-ee6a-4a7e-bab7-1f2eeca951c1 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:59 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a21139f6-ee6a-4a7e-bab7-1f2eeca951c1 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:59 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a21139f6-ee6a-4a7e-bab7-1f2eeca951c1 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:59 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a21139f6-ee6a-4a7e-bab7-1f2eeca951c1 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:40:59 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a21139f6-ee6a-4a7e-bab7-1f2eeca951c1 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:40:59 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a21139f6-ee6a-4a7e-bab7-1f2eeca951c1 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:40:59 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-a21139f6-ee6a-4a7e-bab7-1f2eeca951c1 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43c0aee7b05459d898e0dc2654262fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a793afb3e7045898c59a77975079d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:40:59 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-a21139f6-ee6a-4a7e-bab7-1f2eeca951c1 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0c707ac-b08f-4f18-8262-e1b79d7e17e1" status: 200 len: 1550 microversion: 2.1 time: 0.573304 Apr 17 10:40:59 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 138/403] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:40:59 2023] GET /compute/v2.1/servers/b0c707ac-b08f-4f18-8262-e1b79d7e17e1 => generated 1550 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:41:00 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-0d78d35c-1629-40c1-8094-9ca94e217a7a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:41:00 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-0d78d35c-1629-40c1-8094-9ca94e217a7a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:41:00 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0d78d35c-1629-40c1-8094-9ca94e217a7a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:00 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0d78d35c-1629-40c1-8094-9ca94e217a7a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:00 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0d78d35c-1629-40c1-8094-9ca94e217a7a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:00 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0d78d35c-1629-40c1-8094-9ca94e217a7a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:00 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0d78d35c-1629-40c1-8094-9ca94e217a7a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:00 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0d78d35c-1629-40c1-8094-9ca94e217a7a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:00 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-0d78d35c-1629-40c1-8094-9ca94e217a7a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:41:00 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-0d78d35c-1629-40c1-8094-9ca94e217a7a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:41:00 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-0d78d35c-1629-40c1-8094-9ca94e217a7a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:41:00 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-0d78d35c-1629-40c1-8094-9ca94e217a7a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" status: 200 len: 1755 microversion: 2.87 time: 0.225123 Apr 17 10:41:00 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 140/404] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:41:00 2023] GET /compute/v2.1/servers/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab => generated 1755 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:41:00 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-80f4d2db-58fa-46ca-ae3c-766393465c9e req-d51be5a8-efee-46c7-9041-ffd351780777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597", "name": "network-vif-plugged", "status": "completed", "tag": "3106e21d-664e-4c17-85be-f0a654c4eabc"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:41:00 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-80f4d2db-58fa-46ca-ae3c-766393465c9e req-d51be5a8-efee-46c7-9041-ffd351780777 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:00 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-80f4d2db-58fa-46ca-ae3c-766393465c9e req-d51be5a8-efee-46c7-9041-ffd351780777 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:00 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-80f4d2db-58fa-46ca-ae3c-766393465c9e req-d51be5a8-efee-46c7-9041-ffd351780777 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:00 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-80f4d2db-58fa-46ca-ae3c-766393465c9e req-d51be5a8-efee-46c7-9041-ffd351780777 service nova] Creating event network-vif-plugged:3106e21d-664e-4c17-85be-f0a654c4eabc for instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 on user Apr 17 10:41:00 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-80f4d2db-58fa-46ca-ae3c-766393465c9e req-d51be5a8-efee-46c7-9041-ffd351780777 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034304 Apr 17 10:41:00 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 127/405] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:41:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 10:41:00 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-25371061-6632-456e-8ebd-3c2260ea86a3 req-5b24edf4-b46b-4c3c-9130-6fb47a247efd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0a9753b-207e-4c23-9fea-f7dc89a5edf7", "tag": "6fac7ecb-de62-4a89-b509-210fa4bedd43"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:41:00 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-25371061-6632-456e-8ebd-3c2260ea86a3 req-5b24edf4-b46b-4c3c-9130-6fb47a247efd service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:00 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-25371061-6632-456e-8ebd-3c2260ea86a3 req-5b24edf4-b46b-4c3c-9130-6fb47a247efd service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:00 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-25371061-6632-456e-8ebd-3c2260ea86a3 req-5b24edf4-b46b-4c3c-9130-6fb47a247efd service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:00 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-25371061-6632-456e-8ebd-3c2260ea86a3 req-5b24edf4-b46b-4c3c-9130-6fb47a247efd service nova] Creating event network-changed:6fac7ecb-de62-4a89-b509-210fa4bedd43 for instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7 on user Apr 17 10:41:00 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-25371061-6632-456e-8ebd-3c2260ea86a3 req-5b24edf4-b46b-4c3c-9130-6fb47a247efd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028354 Apr 17 10:41:00 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 139/406] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:41:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:41:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:41:01 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:41:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:01 user devstack@n-api.service[72745]: DEBUG nova.objects.instance [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lazy-loading 'services' on Instance uuid 7792cf72-dc73-4201-9501-4515ce860735 {{(pid=72745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 10:41:01 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-a240cd4c-83ac-46a2-a174-7611df18a5e1 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments/6b225ba1-7dd8-420b-8e44-cae7e5b7a53b" status: 202 len: 0 microversion: 2.1 time: 0.172505 Apr 17 10:41:01 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 141/407] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Apr 17 10:41:01 2023] DELETE /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments/6b225ba1-7dd8-420b-8e44-cae7e5b7a53b => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:41:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-690eac4c-26fb-4dc1-a599-901f50f101b7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:41:01 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-690eac4c-26fb-4dc1-a599-901f50f101b7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:41:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-690eac4c-26fb-4dc1-a599-901f50f101b7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-690eac4c-26fb-4dc1-a599-901f50f101b7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-690eac4c-26fb-4dc1-a599-901f50f101b7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-690eac4c-26fb-4dc1-a599-901f50f101b7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-690eac4c-26fb-4dc1-a599-901f50f101b7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-690eac4c-26fb-4dc1-a599-901f50f101b7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:01 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-690eac4c-26fb-4dc1-a599-901f50f101b7 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045644 Apr 17 10:41:01 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 128/408] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:41:01 2023] GET /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:41:02 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-097187bf-082e-4fb3-9fb1-f6a4ea112f78 req-ccca5bb4-a056-42e6-898e-08755036794f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597", "name": "network-vif-deleted", "tag": "3106e21d-664e-4c17-85be-f0a654c4eabc"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:41:02 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-097187bf-082e-4fb3-9fb1-f6a4ea112f78 req-ccca5bb4-a056-42e6-898e-08755036794f service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:02 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-097187bf-082e-4fb3-9fb1-f6a4ea112f78 req-ccca5bb4-a056-42e6-898e-08755036794f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:02 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-097187bf-082e-4fb3-9fb1-f6a4ea112f78 req-ccca5bb4-a056-42e6-898e-08755036794f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:02 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-097187bf-082e-4fb3-9fb1-f6a4ea112f78 req-ccca5bb4-a056-42e6-898e-08755036794f service nova] Creating event network-vif-deleted:3106e21d-664e-4c17-85be-f0a654c4eabc for instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 on user Apr 17 10:41:02 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-097187bf-082e-4fb3-9fb1-f6a4ea112f78 req-ccca5bb4-a056-42e6-898e-08755036794f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030073 Apr 17 10:41:02 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 140/409] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:41:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:41:03 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-d9b1984c-ca33-458a-bb96-6734953ee838 req-f60943fd-681f-43d7-9df7-0480bb439ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a9753b-207e-4c23-9fea-f7dc89a5edf7", "name": "network-vif-plugged", "status": "completed", "tag": "6fac7ecb-de62-4a89-b509-210fa4bedd43"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:41:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-d9b1984c-ca33-458a-bb96-6734953ee838 req-f60943fd-681f-43d7-9df7-0480bb439ea1 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-d9b1984c-ca33-458a-bb96-6734953ee838 req-f60943fd-681f-43d7-9df7-0480bb439ea1 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-d9b1984c-ca33-458a-bb96-6734953ee838 req-f60943fd-681f-43d7-9df7-0480bb439ea1 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:03 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-d9b1984c-ca33-458a-bb96-6734953ee838 req-f60943fd-681f-43d7-9df7-0480bb439ea1 service nova] Creating event network-vif-plugged:6fac7ecb-de62-4a89-b509-210fa4bedd43 for instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7 on user Apr 17 10:41:03 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-d9b1984c-ca33-458a-bb96-6734953ee838 req-f60943fd-681f-43d7-9df7-0480bb439ea1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031606 Apr 17 10:41:03 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 142/410] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:41:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:41:05 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-d84cba56-f44d-4d3c-a79c-e0629cf12f95 req-c757e0e9-0168-4a2e-b5d7-c674c5a185cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a9753b-207e-4c23-9fea-f7dc89a5edf7", "name": "network-vif-plugged", "status": "completed", "tag": "6fac7ecb-de62-4a89-b509-210fa4bedd43"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:41:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-d84cba56-f44d-4d3c-a79c-e0629cf12f95 req-c757e0e9-0168-4a2e-b5d7-c674c5a185cc service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-d84cba56-f44d-4d3c-a79c-e0629cf12f95 req-c757e0e9-0168-4a2e-b5d7-c674c5a185cc service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-d84cba56-f44d-4d3c-a79c-e0629cf12f95 req-c757e0e9-0168-4a2e-b5d7-c674c5a185cc service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:05 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-d84cba56-f44d-4d3c-a79c-e0629cf12f95 req-c757e0e9-0168-4a2e-b5d7-c674c5a185cc service nova] Creating event network-vif-plugged:6fac7ecb-de62-4a89-b509-210fa4bedd43 for instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7 on user Apr 17 10:41:05 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-d84cba56-f44d-4d3c-a79c-e0629cf12f95 req-c757e0e9-0168-4a2e-b5d7-c674c5a185cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028946 Apr 17 10:41:05 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 129/411] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:41:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:41:08 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-3e78380d-f6a4-44cb-9ccc-0fb4cffa7537 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:41:08 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-3e78380d-f6a4-44cb-9ccc-0fb4cffa7537 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:41:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3e78380d-f6a4-44cb-9ccc-0fb4cffa7537 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3e78380d-f6a4-44cb-9ccc-0fb4cffa7537 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3e78380d-f6a4-44cb-9ccc-0fb4cffa7537 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3e78380d-f6a4-44cb-9ccc-0fb4cffa7537 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3e78380d-f6a4-44cb-9ccc-0fb4cffa7537 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3e78380d-f6a4-44cb-9ccc-0fb4cffa7537 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:08 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-3e78380d-f6a4-44cb-9ccc-0fb4cffa7537 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054560 Apr 17 10:41:08 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 141/412] 10.0.0.210 () {64 vars in 1420 bytes} [Mon Apr 17 10:41:08 2023] GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:41:08 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:41:08 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:41:08 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:41:08 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:41:09 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:09 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:09 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:09 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:09 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:09 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:09 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:41:09 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:41:09 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:41:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:09 user devstack@n-api.service[72745]: DEBUG nova.objects.instance [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lazy-loading 'services' on Instance uuid e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 {{(pid=72745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 10:41:09 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Going to try to terminate instance {{(pid=72744) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:41:09 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-8509a2a4-72b9-47db-b2be-cc406adb73ae tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/os-volume_attachments/bdf94f31-0fa3-4682-abb5-161b0e318367" status: 202 len: 0 microversion: 2.1 time: 0.202454 Apr 17 10:41:09 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 143/413] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Apr 17 10:41:08 2023] DELETE /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/os-volume_attachments/bdf94f31-0fa3-4682-abb5-161b0e318367 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:41:09 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-3e1149cd-91df-4f18-ba02-a8e4d1d53fbd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:41:09 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-3e1149cd-91df-4f18-ba02-a8e4d1d53fbd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:41:09 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3e1149cd-91df-4f18-ba02-a8e4d1d53fbd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:09 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3e1149cd-91df-4f18-ba02-a8e4d1d53fbd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:09 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3e1149cd-91df-4f18-ba02-a8e4d1d53fbd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:09 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3e1149cd-91df-4f18-ba02-a8e4d1d53fbd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:09 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3e1149cd-91df-4f18-ba02-a8e4d1d53fbd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:09 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3e1149cd-91df-4f18-ba02-a8e4d1d53fbd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:09 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-3e1149cd-91df-4f18-ba02-a8e4d1d53fbd tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071011 Apr 17 10:41:09 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 142/414] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:41:09 2023] GET /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:41:09 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-d74c5015-6616-4e75-b26e-298020fd9c81 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d" status: 204 len: 0 microversion: 2.20 time: 0.204677 Apr 17 10:41:09 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 130/415] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 17 10:41:09 2023] DELETE /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 17 10:41:09 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-21360ea5-b2c8-4fef-bbe6-7f5c07ab9388 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:41:09 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-21360ea5-b2c8-4fef-bbe6-7f5c07ab9388 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:41:09 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-21360ea5-b2c8-4fef-bbe6-7f5c07ab9388 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:09 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-21360ea5-b2c8-4fef-bbe6-7f5c07ab9388 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:09 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-21360ea5-b2c8-4fef-bbe6-7f5c07ab9388 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:09 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-21360ea5-b2c8-4fef-bbe6-7f5c07ab9388 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:09 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-21360ea5-b2c8-4fef-bbe6-7f5c07ab9388 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:09 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-21360ea5-b2c8-4fef-bbe6-7f5c07ab9388 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:09 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-21360ea5-b2c8-4fef-bbe6-7f5c07ab9388 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:41:09 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-21360ea5-b2c8-4fef-bbe6-7f5c07ab9388 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:41:09 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-21360ea5-b2c8-4fef-bbe6-7f5c07ab9388 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:41:09 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-21360ea5-b2c8-4fef-bbe6-7f5c07ab9388 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d" status: 200 len: 1706 microversion: 2.20 time: 0.281120 Apr 17 10:41:09 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 144/416] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:41:09 2023] GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d => generated 1706 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:41:09 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-eddcf266-7955-4873-9c78-e2b77d127c28 req-bac22306-be46-4ead-a2d2-3c93a1b4bb4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4315753-415c-45cd-b06f-da1e3ccc6e4d", "name": "network-vif-unplugged", "status": "completed", "tag": "cd279a0c-99eb-4e32-876e-6d2208cc1db2"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:41:09 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-eddcf266-7955-4873-9c78-e2b77d127c28 req-bac22306-be46-4ead-a2d2-3c93a1b4bb4e service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:09 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-eddcf266-7955-4873-9c78-e2b77d127c28 req-bac22306-be46-4ead-a2d2-3c93a1b4bb4e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:09 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-eddcf266-7955-4873-9c78-e2b77d127c28 req-bac22306-be46-4ead-a2d2-3c93a1b4bb4e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:09 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-eddcf266-7955-4873-9c78-e2b77d127c28 req-bac22306-be46-4ead-a2d2-3c93a1b4bb4e service nova] Creating event network-vif-unplugged:cd279a0c-99eb-4e32-876e-6d2208cc1db2 for instance c4315753-415c-45cd-b06f-da1e3ccc6e4d on user Apr 17 10:41:09 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-eddcf266-7955-4873-9c78-e2b77d127c28 req-bac22306-be46-4ead-a2d2-3c93a1b4bb4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032124 Apr 17 10:41:09 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 143/417] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:41:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:41:11 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-2dc80647-5cb1-4a39-804b-6961fb6000e9 req-877f9528-6fe9-49af-84ee-50d9c272f530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4315753-415c-45cd-b06f-da1e3ccc6e4d", "name": "network-vif-plugged", "status": "completed", "tag": "cd279a0c-99eb-4e32-876e-6d2208cc1db2"}, {"server_uuid": "c4315753-415c-45cd-b06f-da1e3ccc6e4d", "name": "network-vif-deleted", "tag": "cd279a0c-99eb-4e32-876e-6d2208cc1db2"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:41:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-2dc80647-5cb1-4a39-804b-6961fb6000e9 req-877f9528-6fe9-49af-84ee-50d9c272f530 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-2dc80647-5cb1-4a39-804b-6961fb6000e9 req-877f9528-6fe9-49af-84ee-50d9c272f530 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-2dc80647-5cb1-4a39-804b-6961fb6000e9 req-877f9528-6fe9-49af-84ee-50d9c272f530 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-2dc80647-5cb1-4a39-804b-6961fb6000e9 req-877f9528-6fe9-49af-84ee-50d9c272f530 service nova] Creating event network-vif-plugged:cd279a0c-99eb-4e32-876e-6d2208cc1db2 for instance c4315753-415c-45cd-b06f-da1e3ccc6e4d on user Apr 17 10:41:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-2dc80647-5cb1-4a39-804b-6961fb6000e9 req-877f9528-6fe9-49af-84ee-50d9c272f530 service nova] Creating event network-vif-deleted:cd279a0c-99eb-4e32-876e-6d2208cc1db2 for instance c4315753-415c-45cd-b06f-da1e3ccc6e4d on user Apr 17 10:41:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-2dc80647-5cb1-4a39-804b-6961fb6000e9 req-877f9528-6fe9-49af-84ee-50d9c272f530 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051060 Apr 17 10:41:11 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 131/418] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:41:11 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:41:16 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-84da9506-8788-4d6e-b311-0928505553b1 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:41:16 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-84da9506-8788-4d6e-b311-0928505553b1 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:41:16 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-84da9506-8788-4d6e-b311-0928505553b1 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:16 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-84da9506-8788-4d6e-b311-0928505553b1 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:16 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-84da9506-8788-4d6e-b311-0928505553b1 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:16 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-84da9506-8788-4d6e-b311-0928505553b1 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:16 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-84da9506-8788-4d6e-b311-0928505553b1 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:16 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-84da9506-8788-4d6e-b311-0928505553b1 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:17 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-84da9506-8788-4d6e-b311-0928505553b1 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9862432f87f4500a46f32a0b27d54d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a17ec3e1b314acbb701f2d2d27d0560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:41:17 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-84da9506-8788-4d6e-b311-0928505553b1 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99" status: 200 len: 1639 microversion: 2.1 time: 0.278136 Apr 17 10:41:17 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 145/419] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:41:16 2023] GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99 => generated 1639 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 17 10:41:25 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:41:25 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:41:25 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-19e1298e-55a8-4850-9400-5eaa9af3a1a1 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:41:25 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-19e1298e-55a8-4850-9400-5eaa9af3a1a1 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:41:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-19e1298e-55a8-4850-9400-5eaa9af3a1a1 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-19e1298e-55a8-4850-9400-5eaa9af3a1a1 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-19e1298e-55a8-4850-9400-5eaa9af3a1a1 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-19e1298e-55a8-4850-9400-5eaa9af3a1a1 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-19e1298e-55a8-4850-9400-5eaa9af3a1a1 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-19e1298e-55a8-4850-9400-5eaa9af3a1a1 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:25 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-19e1298e-55a8-4850-9400-5eaa9af3a1a1 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051744 Apr 17 10:41:25 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 144/420] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:41:25 2023] GET /compute/v2.1/servers/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 17 10:41:25 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:41:25 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:41:25 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1128777175", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "networks": [{"uuid": "0635a321-37ea-416c-9e45-a059e4a4a9bb"}]}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:41:25 user devstack@n-api.service[72744]: DEBUG nova.network.neutron [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] validate_networks() for [('0635a321-37ea-416c-9e45-a059e4a4a9bb', None, None, None, None, None)] {{(pid=72744) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:41:26 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Flavor limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:41:26 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Image limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:41:26 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Flavor pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:41:26 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Image pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:41:26 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:41:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:26 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Getting quotas for project 33eedb851ee244768016f5bf203d2f9f. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:41:26 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Getting quotas for user f69d4d16a4bc479ba2a8a80f359135f7 and project 33eedb851ee244768016f5bf203d2f9f. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:41:26 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Going to run 1 instances... {{(pid=72744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:41:26 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:41:26 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-006ee7b7-e474-4882-8a9e-9bcc3eebbeec tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.669548 Apr 17 10:41:26 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 132/421] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:41:25 2023] POST /compute/v2.1/servers => generated 378 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 10:41:26 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-afe04126-d8ef-4750-bb96-f0a5fcba68dd tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:41:26 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-afe04126-d8ef-4750-bb96-f0a5fcba68dd tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:41:26 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:41:26 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-afe04126-d8ef-4750-bb96-f0a5fcba68dd tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69d4d16a4bc479ba2a8a80f359135f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33eedb851ee244768016f5bf203d2f9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:41:26 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-afe04126-d8ef-4750-bb96-f0a5fcba68dd tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4" status: 200 len: 1212 microversion: 2.1 time: 0.093858 Apr 17 10:41:26 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 146/422] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:41:26 2023] GET /compute/v2.1/servers/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4 => generated 1212 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:41:29 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-b456d9c7-0f06-4f5b-b61f-28fadb05f643 req-82828b0f-1719-4c07-958c-89c448f7af2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4", "tag": "bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:41:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-b456d9c7-0f06-4f5b-b61f-28fadb05f643 req-82828b0f-1719-4c07-958c-89c448f7af2b service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-b456d9c7-0f06-4f5b-b61f-28fadb05f643 req-82828b0f-1719-4c07-958c-89c448f7af2b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-b456d9c7-0f06-4f5b-b61f-28fadb05f643 req-82828b0f-1719-4c07-958c-89c448f7af2b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:29 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-b456d9c7-0f06-4f5b-b61f-28fadb05f643 req-82828b0f-1719-4c07-958c-89c448f7af2b service nova] Creating event network-changed:bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f for instance 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4 on user Apr 17 10:41:29 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-b456d9c7-0f06-4f5b-b61f-28fadb05f643 req-82828b0f-1719-4c07-958c-89c448f7af2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028561 Apr 17 10:41:29 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 145/423] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:41:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 10:41:31 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-4f6dcdb4-6eba-41b0-9fe6-9a846c4b8211 req-083f5b86-0627-404d-ad5e-82d75ccc720c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4", "name": "network-vif-plugged", "status": "completed", "tag": "bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:41:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-4f6dcdb4-6eba-41b0-9fe6-9a846c4b8211 req-083f5b86-0627-404d-ad5e-82d75ccc720c service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-4f6dcdb4-6eba-41b0-9fe6-9a846c4b8211 req-083f5b86-0627-404d-ad5e-82d75ccc720c service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-4f6dcdb4-6eba-41b0-9fe6-9a846c4b8211 req-083f5b86-0627-404d-ad5e-82d75ccc720c service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:31 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-4f6dcdb4-6eba-41b0-9fe6-9a846c4b8211 req-083f5b86-0627-404d-ad5e-82d75ccc720c service nova] Creating event network-vif-plugged:bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f for instance 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4 on user Apr 17 10:41:31 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-4f6dcdb4-6eba-41b0-9fe6-9a846c4b8211 req-083f5b86-0627-404d-ad5e-82d75ccc720c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033571 Apr 17 10:41:31 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 133/424] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:41:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:41:33 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-dd9ac49b-fd87-4a18-9baf-b5919ecaee56 req-c2d8111c-03a8-4fe7-ae92-9c0afc0425ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4", "name": "network-vif-plugged", "status": "completed", "tag": "bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:41:33 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:41:33 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-dd9ac49b-fd87-4a18-9baf-b5919ecaee56 req-c2d8111c-03a8-4fe7-ae92-9c0afc0425ad service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:33 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-dd9ac49b-fd87-4a18-9baf-b5919ecaee56 req-c2d8111c-03a8-4fe7-ae92-9c0afc0425ad service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:33 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-dd9ac49b-fd87-4a18-9baf-b5919ecaee56 req-c2d8111c-03a8-4fe7-ae92-9c0afc0425ad service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:33 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-dd9ac49b-fd87-4a18-9baf-b5919ecaee56 req-c2d8111c-03a8-4fe7-ae92-9c0afc0425ad service nova] Creating event network-vif-plugged:bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f for instance 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4 on user Apr 17 10:41:33 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-dd9ac49b-fd87-4a18-9baf-b5919ecaee56 req-c2d8111c-03a8-4fe7-ae92-9c0afc0425ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035807 Apr 17 10:41:33 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 147/425] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:41:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:41:46 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=4 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:41:46 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=8 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:41:46 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-37910b3f-5a00-491b-beb7-acfd0fc3862e tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:41:46 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-37910b3f-5a00-491b-beb7-acfd0fc3862e tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:41:46 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-37910b3f-5a00-491b-beb7-acfd0fc3862e tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:46 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-37910b3f-5a00-491b-beb7-acfd0fc3862e tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:46 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-37910b3f-5a00-491b-beb7-acfd0fc3862e tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:46 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-37910b3f-5a00-491b-beb7-acfd0fc3862e tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:46 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-37910b3f-5a00-491b-beb7-acfd0fc3862e tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:46 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-37910b3f-5a00-491b-beb7-acfd0fc3862e tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:47 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-37910b3f-5a00-491b-beb7-acfd0fc3862e tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e61a5e172c34636b183ef9c84b714d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b831c3b6c244dda1821583a6b8cd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:41:47 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-37910b3f-5a00-491b-beb7-acfd0fc3862e tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0a9753b-207e-4c23-9fea-f7dc89a5edf7" status: 200 len: 1493 microversion: 2.1 time: 0.353499 Apr 17 10:41:47 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 146/426] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:41:46 2023] GET /compute/v2.1/servers/b0a9753b-207e-4c23-9fea-f7dc89a5edf7 => generated 1493 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:41:48 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:41:48 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:41:48 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:41:48 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=4 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:41:48 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-5d0048dd-71d6-4168-a095-8a20750eba81 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:41:48 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-5d0048dd-71d6-4168-a095-8a20750eba81 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:41:48 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5d0048dd-71d6-4168-a095-8a20750eba81 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:48 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5d0048dd-71d6-4168-a095-8a20750eba81 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:48 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5d0048dd-71d6-4168-a095-8a20750eba81 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:48 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5d0048dd-71d6-4168-a095-8a20750eba81 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:48 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5d0048dd-71d6-4168-a095-8a20750eba81 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:48 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5d0048dd-71d6-4168-a095-8a20750eba81 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:48 user devstack@n-api.service[72744]: INFO nova.api.openstack.wsgi [None req-5d0048dd-71d6-4168-a095-8a20750eba81 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] HTTP exception thrown: Instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 could not be found. Apr 17 10:41:48 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-5d0048dd-71d6-4168-a095-8a20750eba81 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Request method failure captured: Apr 17 10:41:48 user devstack@n-api.service[72744]: request: GET /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 HTTP/1.1 Apr 17 10:41:48 user devstack@n-api.service[72744]: Accept: application/json Apr 17 10:41:48 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 10:41:48 user devstack@n-api.service[72744]: Connection: close Apr 17 10:41:48 user devstack@n-api.service[72744]: Content-Length: 0 Apr 17 10:41:48 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 10:41:48 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 10:41:48 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 10:41:48 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 10:41:48 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSF5mKifOufpDeq6Qqr6gMHFsQEqY4mgxi7FIk1h6qPgxg2YVvsafchEpZ2ip9ePVaTpbOq1U_QbRQj5aQak4elrjPsYdeYaSJu8xtyRj06bauHrX2XRdWSkp0V5l9H716IHIzKx0UPJEFpMNHU52OW5cXG12blwPy2K3NW-wmHa-JA Apr 17 10:41:48 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 10:41:48 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 10:41:48 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 10:41:48 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 10:41:48 user devstack@n-api.service[72744]: X-Openstack-Nova-Api-Version: 2.49 Apr 17 10:41:48 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 10:41:48 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 10:41:48 user devstack@n-api.service[72744]: X-Project-Id: 507228fb562e461e91a628829ce32d80 Apr 17 10:41:48 user devstack@n-api.service[72744]: X-Project-Name: tempest-TaggedAttachmentsTest-1382963185 Apr 17 10:41:48 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 10:41:48 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 10:41:48 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/507228fb562e461e91a628829ce32d80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/507228fb562e461e91a628829ce32d80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/507228fb562e461e91a628829ce32d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:41:48 user devstack@n-api.service[72744]: X-Tenant: tempest-TaggedAttachmentsTest-1382963185 Apr 17 10:41:48 user devstack@n-api.service[72744]: X-Tenant-Id: 507228fb562e461e91a628829ce32d80 Apr 17 10:41:48 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1382963185 Apr 17 10:41:48 user devstack@n-api.service[72744]: X-User: tempest-TaggedAttachmentsTest-1382963185-project-member Apr 17 10:41:48 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 10:41:48 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 10:41:48 user devstack@n-api.service[72744]: X-User-Id: ab512fbd85694415a5f7af8b689814d4 Apr 17 10:41:48 user devstack@n-api.service[72744]: X-User-Name: tempest-TaggedAttachmentsTest-1382963185-project-member Apr 17 10:41:48 user devstack@n-api.service[72744]: method: > Apr 17 10:41:48 user devstack@n-api.service[72744]: exception: Instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 could not be found. Apr 17 10:41:48 user devstack@n-api.service[72744]: action_args: {'id': '9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597'} Apr 17 10:41:48 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 could not be found. Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 could not be found. Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 could not be found. Apr 17 10:41:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:41:48 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-5d0048dd-71d6-4168-a095-8a20750eba81 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Returning 404 to user: Instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 could not be found. {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:41:48 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-5d0048dd-71d6-4168-a095-8a20750eba81 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" status: 404 len: 111 microversion: 2.49 time: 0.045640 Apr 17 10:41:48 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 134/427] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:41:48 2023] GET /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 10:41:48 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:41:48 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=5 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:41:48 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:41:48 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-ae68cf21-996c-4854-862a-8950222669ea tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Calling method '.version_select at 0x7fc55a88f5b0>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:41:48 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-ae68cf21-996c-4854-862a-8950222669ea tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1227280417" status: 204 len: 0 microversion: 2.49 time: 0.038801 Apr 17 10:41:48 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 148/428] 10.0.0.210 () {64 vars in 1339 bytes} [Mon Apr 17 10:41:48 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1227280417 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 17 10:41:50 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-803ff518-3cce-4606-8c44-199e8c366e63 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:41:50 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-803ff518-3cce-4606-8c44-199e8c366e63 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:41:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-803ff518-3cce-4606-8c44-199e8c366e63 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-803ff518-3cce-4606-8c44-199e8c366e63 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-803ff518-3cce-4606-8c44-199e8c366e63 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-803ff518-3cce-4606-8c44-199e8c366e63 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-803ff518-3cce-4606-8c44-199e8c366e63 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-803ff518-3cce-4606-8c44-199e8c366e63 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:50 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-803ff518-3cce-4606-8c44-199e8c366e63 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] HTTP exception thrown: Instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 could not be found. Apr 17 10:41:50 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-803ff518-3cce-4606-8c44-199e8c366e63 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Request method failure captured: Apr 17 10:41:50 user devstack@n-api.service[72743]: request: DELETE /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 HTTP/1.1 Apr 17 10:41:50 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:41:50 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:41:50 user devstack@n-api.service[72743]: Connection: close Apr 17 10:41:50 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:41:50 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:41:50 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:41:50 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:41:50 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:41:50 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSF5mKifOufpDeq6Qqr6gMHFsQEqY4mgxi7FIk1h6qPgxg2YVvsafchEpZ2ip9ePVaTpbOq1U_QbRQj5aQak4elrjPsYdeYaSJu8xtyRj06bauHrX2XRdWSkp0V5l9H716IHIzKx0UPJEFpMNHU52OW5cXG12blwPy2K3NW-wmHa-JA Apr 17 10:41:50 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:41:50 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:41:50 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:41:50 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:41:50 user devstack@n-api.service[72743]: X-Openstack-Nova-Api-Version: 2.49 Apr 17 10:41:50 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:41:50 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:41:50 user devstack@n-api.service[72743]: X-Project-Id: 507228fb562e461e91a628829ce32d80 Apr 17 10:41:50 user devstack@n-api.service[72743]: X-Project-Name: tempest-TaggedAttachmentsTest-1382963185 Apr 17 10:41:50 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:41:50 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:41:50 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/507228fb562e461e91a628829ce32d80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/507228fb562e461e91a628829ce32d80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/507228fb562e461e91a628829ce32d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:41:50 user devstack@n-api.service[72743]: X-Tenant: tempest-TaggedAttachmentsTest-1382963185 Apr 17 10:41:50 user devstack@n-api.service[72743]: X-Tenant-Id: 507228fb562e461e91a628829ce32d80 Apr 17 10:41:50 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1382963185 Apr 17 10:41:50 user devstack@n-api.service[72743]: X-User: tempest-TaggedAttachmentsTest-1382963185-project-member Apr 17 10:41:50 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:41:50 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:41:50 user devstack@n-api.service[72743]: X-User-Id: ab512fbd85694415a5f7af8b689814d4 Apr 17 10:41:50 user devstack@n-api.service[72743]: X-User-Name: tempest-TaggedAttachmentsTest-1382963185-project-member Apr 17 10:41:50 user devstack@n-api.service[72743]: method: > Apr 17 10:41:50 user devstack@n-api.service[72743]: exception: Instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 could not be found. Apr 17 10:41:50 user devstack@n-api.service[72743]: action_args: {'id': '9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597'} Apr 17 10:41:50 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 could not be found. Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 could not be found. Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 could not be found. Apr 17 10:41:50 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:41:50 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-803ff518-3cce-4606-8c44-199e8c366e63 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Returning 404 to user: Instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:41:50 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-803ff518-3cce-4606-8c44-199e8c366e63 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" status: 404 len: 111 microversion: 2.49 time: 0.032946 Apr 17 10:41:50 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 147/429] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 17 10:41:50 2023] DELETE /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 10:41:50 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-f513a474-fc95-4f4e-80c2-a72c73e91b49 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:41:50 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-f513a474-fc95-4f4e-80c2-a72c73e91b49 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] [instance: 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:41:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f513a474-fc95-4f4e-80c2-a72c73e91b49 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f513a474-fc95-4f4e-80c2-a72c73e91b49 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f513a474-fc95-4f4e-80c2-a72c73e91b49 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f513a474-fc95-4f4e-80c2-a72c73e91b49 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f513a474-fc95-4f4e-80c2-a72c73e91b49 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f513a474-fc95-4f4e-80c2-a72c73e91b49 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:50 user devstack@n-api.service[72744]: INFO nova.api.openstack.wsgi [None req-f513a474-fc95-4f4e-80c2-a72c73e91b49 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] HTTP exception thrown: Instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 could not be found. Apr 17 10:41:50 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-f513a474-fc95-4f4e-80c2-a72c73e91b49 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Request method failure captured: Apr 17 10:41:50 user devstack@n-api.service[72744]: request: GET /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 HTTP/1.1 Apr 17 10:41:50 user devstack@n-api.service[72744]: Accept: application/json Apr 17 10:41:50 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 10:41:50 user devstack@n-api.service[72744]: Connection: close Apr 17 10:41:50 user devstack@n-api.service[72744]: Content-Length: 0 Apr 17 10:41:50 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 10:41:50 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 10:41:50 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 10:41:50 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 10:41:50 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSF5mKifOufpDeq6Qqr6gMHFsQEqY4mgxi7FIk1h6qPgxg2YVvsafchEpZ2ip9ePVaTpbOq1U_QbRQj5aQak4elrjPsYdeYaSJu8xtyRj06bauHrX2XRdWSkp0V5l9H716IHIzKx0UPJEFpMNHU52OW5cXG12blwPy2K3NW-wmHa-JA Apr 17 10:41:50 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 10:41:50 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 10:41:50 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 10:41:50 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 10:41:50 user devstack@n-api.service[72744]: X-Openstack-Nova-Api-Version: 2.49 Apr 17 10:41:50 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 10:41:50 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 10:41:50 user devstack@n-api.service[72744]: X-Project-Id: 507228fb562e461e91a628829ce32d80 Apr 17 10:41:50 user devstack@n-api.service[72744]: X-Project-Name: tempest-TaggedAttachmentsTest-1382963185 Apr 17 10:41:50 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 10:41:50 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 10:41:50 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/507228fb562e461e91a628829ce32d80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/507228fb562e461e91a628829ce32d80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/507228fb562e461e91a628829ce32d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:41:50 user devstack@n-api.service[72744]: X-Tenant: tempest-TaggedAttachmentsTest-1382963185 Apr 17 10:41:50 user devstack@n-api.service[72744]: X-Tenant-Id: 507228fb562e461e91a628829ce32d80 Apr 17 10:41:50 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1382963185 Apr 17 10:41:50 user devstack@n-api.service[72744]: X-User: tempest-TaggedAttachmentsTest-1382963185-project-member Apr 17 10:41:50 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 10:41:50 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 10:41:50 user devstack@n-api.service[72744]: X-User-Id: ab512fbd85694415a5f7af8b689814d4 Apr 17 10:41:50 user devstack@n-api.service[72744]: X-User-Name: tempest-TaggedAttachmentsTest-1382963185-project-member Apr 17 10:41:50 user devstack@n-api.service[72744]: method: > Apr 17 10:41:50 user devstack@n-api.service[72744]: exception: Instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 could not be found. Apr 17 10:41:50 user devstack@n-api.service[72744]: action_args: {'id': '9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597'} Apr 17 10:41:50 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 could not be found. Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 could not be found. Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 could not be found. Apr 17 10:41:50 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:41:50 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-f513a474-fc95-4f4e-80c2-a72c73e91b49 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] Returning 404 to user: Instance 9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 could not be found. {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:41:50 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-f513a474-fc95-4f4e-80c2-a72c73e91b49 tempest-TaggedAttachmentsTest-1382963185 tempest-TaggedAttachmentsTest-1382963185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597" status: 404 len: 111 microversion: 2.49 time: 0.027350 Apr 17 10:41:50 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 135/430] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:41:50 2023] GET /compute/v2.1/servers/9e8c24a9-9f18-48c7-aa8d-ed74f5cb0597 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 10:41:51 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-167d6242-2287-4251-8f73-06d394d384e5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:41:51 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-167d6242-2287-4251-8f73-06d394d384e5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:41:51 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-167d6242-2287-4251-8f73-06d394d384e5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:51 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-167d6242-2287-4251-8f73-06d394d384e5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:51 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-167d6242-2287-4251-8f73-06d394d384e5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:51 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-167d6242-2287-4251-8f73-06d394d384e5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:51 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-167d6242-2287-4251-8f73-06d394d384e5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:51 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-167d6242-2287-4251-8f73-06d394d384e5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:51 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-167d6242-2287-4251-8f73-06d394d384e5 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048094 Apr 17 10:41:51 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 149/431] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:41:51 2023] GET /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 17 10:41:59 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-fae5a2ae-449e-4d4d-8770-18e08a5242b6 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:41:59 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-fae5a2ae-449e-4d4d-8770-18e08a5242b6 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:41:59 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fae5a2ae-449e-4d4d-8770-18e08a5242b6 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:59 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fae5a2ae-449e-4d4d-8770-18e08a5242b6 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:59 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fae5a2ae-449e-4d4d-8770-18e08a5242b6 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:59 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fae5a2ae-449e-4d4d-8770-18e08a5242b6 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:59 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fae5a2ae-449e-4d4d-8770-18e08a5242b6 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:59 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fae5a2ae-449e-4d4d-8770-18e08a5242b6 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:59 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-fae5a2ae-449e-4d4d-8770-18e08a5242b6 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049613 Apr 17 10:41:59 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 148/432] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:41:59 2023] GET /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 17 10:41:59 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-5f4a0fde-676f-4c69-b538-340bbad19697 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:41:59 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-5f4a0fde-676f-4c69-b538-340bbad19697 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:41:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5f4a0fde-676f-4c69-b538-340bbad19697 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5f4a0fde-676f-4c69-b538-340bbad19697 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5f4a0fde-676f-4c69-b538-340bbad19697 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5f4a0fde-676f-4c69-b538-340bbad19697 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:41:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5f4a0fde-676f-4c69-b538-340bbad19697 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:41:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-5f4a0fde-676f-4c69-b538-340bbad19697 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:41:59 user devstack@n-api.service[72744]: INFO nova.api.openstack.wsgi [None req-5f4a0fde-676f-4c69-b538-340bbad19697 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] HTTP exception thrown: Instance c4315753-415c-45cd-b06f-da1e3ccc6e4d could not be found. Apr 17 10:41:59 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-5f4a0fde-676f-4c69-b538-340bbad19697 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Request method failure captured: Apr 17 10:41:59 user devstack@n-api.service[72744]: request: GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d HTTP/1.1 Apr 17 10:41:59 user devstack@n-api.service[72744]: Accept: application/json Apr 17 10:41:59 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 10:41:59 user devstack@n-api.service[72744]: Connection: close Apr 17 10:41:59 user devstack@n-api.service[72744]: Content-Length: 0 Apr 17 10:41:59 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 10:41:59 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 10:41:59 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 10:41:59 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 10:41:59 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSC2U-PxTQNibFyn7A1yYJQ2OCxZjHmsnus6b0TVvFwoNVfsvv_nH14Ltyw4E8iMU6H2pZSlRL1UjLHUBMAXKWV-535N62tbhRrfE7gt2YL3MZzPrHSr9gwyC4tQ9ETt_SC51dCtR_N06y5qW_TL_VKyh7CJY12TnLzcy4JxJHpHIlM Apr 17 10:41:59 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 10:41:59 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 10:41:59 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 10:41:59 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 10:41:59 user devstack@n-api.service[72744]: X-Openstack-Nova-Api-Version: 2.20 Apr 17 10:41:59 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 10:41:59 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 10:41:59 user devstack@n-api.service[72744]: X-Project-Id: e6dac880f4294283ae7838bfa0edf5c1 Apr 17 10:41:59 user devstack@n-api.service[72744]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1174346715 Apr 17 10:41:59 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 10:41:59 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 10:41:59 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6dac880f4294283ae7838bfa0edf5c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6dac880f4294283ae7838bfa0edf5c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e6dac880f4294283ae7838bfa0edf5c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:41:59 user devstack@n-api.service[72744]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1174346715 Apr 17 10:41:59 user devstack@n-api.service[72744]: X-Tenant-Id: e6dac880f4294283ae7838bfa0edf5c1 Apr 17 10:41:59 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1174346715 Apr 17 10:41:59 user devstack@n-api.service[72744]: X-User: tempest-AttachVolumeShelveTestJSON-1174346715-project-member Apr 17 10:41:59 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 10:41:59 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 10:41:59 user devstack@n-api.service[72744]: X-User-Id: aea97828312f45ffa1b7148c375a7f9a Apr 17 10:41:59 user devstack@n-api.service[72744]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1174346715-project-member Apr 17 10:41:59 user devstack@n-api.service[72744]: method: > Apr 17 10:41:59 user devstack@n-api.service[72744]: exception: Instance c4315753-415c-45cd-b06f-da1e3ccc6e4d could not be found. Apr 17 10:41:59 user devstack@n-api.service[72744]: action_args: {'id': 'c4315753-415c-45cd-b06f-da1e3ccc6e4d'} Apr 17 10:41:59 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4315753-415c-45cd-b06f-da1e3ccc6e4d could not be found. Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4315753-415c-45cd-b06f-da1e3ccc6e4d could not be found. Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4315753-415c-45cd-b06f-da1e3ccc6e4d could not be found. Apr 17 10:41:59 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:41:59 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-5f4a0fde-676f-4c69-b538-340bbad19697 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Returning 404 to user: Instance c4315753-415c-45cd-b06f-da1e3ccc6e4d could not be found. {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:41:59 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-5f4a0fde-676f-4c69-b538-340bbad19697 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d" status: 404 len: 111 microversion: 2.20 time: 0.031980 Apr 17 10:41:59 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 136/433] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:41:59 2023] GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 10:41:59 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-942a7728-bdab-4a16-bc71-ffddc09cd86b tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '.version_select at 0x7fc55a9cd900>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:41:59 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-942a7728-bdab-4a16-bc71-ffddc09cd86b tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-850060525" status: 204 len: 0 microversion: 2.20 time: 0.021458 Apr 17 10:41:59 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 150/434] 10.0.0.210 () {64 vars in 1336 bytes} [Mon Apr 17 10:41:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-850060525 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 17 10:42:00 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-fbf39075-33b4-4bf8-a3d0-e7e546564864 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:42:00 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-fbf39075-33b4-4bf8-a3d0-e7e546564864 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:42:00 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fbf39075-33b4-4bf8-a3d0-e7e546564864 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:00 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fbf39075-33b4-4bf8-a3d0-e7e546564864 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:00 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fbf39075-33b4-4bf8-a3d0-e7e546564864 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:00 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fbf39075-33b4-4bf8-a3d0-e7e546564864 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:00 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fbf39075-33b4-4bf8-a3d0-e7e546564864 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:00 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fbf39075-33b4-4bf8-a3d0-e7e546564864 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:00 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-05bfd683-9889-4c30-b629-849cc6507a6a tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Action: 'create', calling method: .version_select at 0x7fc55a9cc160>, body: {"keypair": {"name": "tempest-keypair-1963349943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDukjSLeCue+jobK7F8+eqUod8S/SPwFRRjU948hgPTGwDtheEfK10Qt0k7bGB9RgcPDrWEuC4lYGOl33GS6HRjNgrGZR1aDCH1PVL2Qkt1O7P4VtYS1j0HHPoUkaMdtKQ=="}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:42:00 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-fbf39075-33b4-4bf8-a3d0-e7e546564864 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab/action" status: 202 len: 0 microversion: 2.87 time: 0.098245 Apr 17 10:42:00 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 149/435] 10.0.0.210 () {66 vars in 1396 bytes} [Mon Apr 17 10:42:00 2023] POST /compute/v2.1/servers/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:42:00 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-05bfd683-9889-4c30-b629-849cc6507a6a tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Getting quotas for project e6dac880f4294283ae7838bfa0edf5c1. Resources: {'key_pairs'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:42:00 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-3e33143e-d53a-4416-a3e3-83e05dd32d29 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:42:00 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-3e33143e-d53a-4416-a3e3-83e05dd32d29 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:42:00 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-05bfd683-9889-4c30-b629-849cc6507a6a tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Getting quotas for user aea97828312f45ffa1b7148c375a7f9a and project e6dac880f4294283ae7838bfa0edf5c1. Resources: {'key_pairs'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:42:00 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3e33143e-d53a-4416-a3e3-83e05dd32d29 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:00 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3e33143e-d53a-4416-a3e3-83e05dd32d29 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:00 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3e33143e-d53a-4416-a3e3-83e05dd32d29 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:00 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3e33143e-d53a-4416-a3e3-83e05dd32d29 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:00 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3e33143e-d53a-4416-a3e3-83e05dd32d29 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:00 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3e33143e-d53a-4416-a3e3-83e05dd32d29 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:00 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-05bfd683-9889-4c30-b629-849cc6507a6a tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.066106 Apr 17 10:42:00 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 137/436] 10.0.0.210 () {66 vars in 1277 bytes} [Mon Apr 17 10:42:00 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 68 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 17 10:42:00 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-3e33143e-d53a-4416-a3e3-83e05dd32d29 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:42:00 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-3e33143e-d53a-4416-a3e3-83e05dd32d29 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:42:00 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-3e33143e-d53a-4416-a3e3-83e05dd32d29 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:42:00 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-3e33143e-d53a-4416-a3e3-83e05dd32d29 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" status: 200 len: 1763 microversion: 2.87 time: 0.494628 Apr 17 10:42:00 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 151/437] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:42:00 2023] GET /compute/v2.1/servers/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab => generated 1763 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:42:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:42:01 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:42:01 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:01 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:01 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:01 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:01 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:01 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-d5da055b-87fd-455c-b959-35529a133099 req-eceda13c-c014-4341-850b-f9827b50c4c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c707ac-b08f-4f18-8262-e1b79d7e17e1", "tag": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:42:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-d5da055b-87fd-455c-b959-35529a133099 req-eceda13c-c014-4341-850b-f9827b50c4c1 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-d5da055b-87fd-455c-b959-35529a133099 req-eceda13c-c014-4341-850b-f9827b50c4c1 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-d5da055b-87fd-455c-b959-35529a133099 req-eceda13c-c014-4341-850b-f9827b50c4c1 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:01 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Going to try to terminate instance {{(pid=72743) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:42:01 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-d5da055b-87fd-455c-b959-35529a133099 req-eceda13c-c014-4341-850b-f9827b50c4c1 service nova] Creating event network-changed:90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 for instance b0c707ac-b08f-4f18-8262-e1b79d7e17e1 on user Apr 17 10:42:01 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-d5da055b-87fd-455c-b959-35529a133099 req-eceda13c-c014-4341-850b-f9827b50c4c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056775 Apr 17 10:42:01 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 138/438] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:42:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:42:01 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-7cdb8455-967b-4f25-9ec3-de08d577813a tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b0c707ac-b08f-4f18-8262-e1b79d7e17e1" status: 204 len: 0 microversion: 2.1 time: 0.150200 Apr 17 10:42:01 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 150/439] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:42:01 2023] DELETE /compute/v2.1/servers/b0c707ac-b08f-4f18-8262-e1b79d7e17e1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:42:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-8684bcf4-a25c-44d1-b3d3-4aef2a1648c5 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:42:01 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-8684bcf4-a25c-44d1-b3d3-4aef2a1648c5 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:42:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8684bcf4-a25c-44d1-b3d3-4aef2a1648c5 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8684bcf4-a25c-44d1-b3d3-4aef2a1648c5 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8684bcf4-a25c-44d1-b3d3-4aef2a1648c5 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8684bcf4-a25c-44d1-b3d3-4aef2a1648c5 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8684bcf4-a25c-44d1-b3d3-4aef2a1648c5 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8684bcf4-a25c-44d1-b3d3-4aef2a1648c5 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:02 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-a7b1db2b-c379-4a97-934f-2dd57e554c02 req-9747c08b-fc6d-4873-82e2-b63fcd729fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c707ac-b08f-4f18-8262-e1b79d7e17e1", "name": "network-vif-unplugged", "status": "completed", "tag": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:42:02 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-8684bcf4-a25c-44d1-b3d3-4aef2a1648c5 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43c0aee7b05459d898e0dc2654262fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a793afb3e7045898c59a77975079d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:42:02 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-8684bcf4-a25c-44d1-b3d3-4aef2a1648c5 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0c707ac-b08f-4f18-8262-e1b79d7e17e1" status: 200 len: 1556 microversion: 2.1 time: 0.600508 Apr 17 10:42:02 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 152/440] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:42:01 2023] GET /compute/v2.1/servers/b0c707ac-b08f-4f18-8262-e1b79d7e17e1 => generated 1556 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:42:02 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-a7b1db2b-c379-4a97-934f-2dd57e554c02 req-9747c08b-fc6d-4873-82e2-b63fcd729fac service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:02 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-a7b1db2b-c379-4a97-934f-2dd57e554c02 req-9747c08b-fc6d-4873-82e2-b63fcd729fac service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:02 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-a7b1db2b-c379-4a97-934f-2dd57e554c02 req-9747c08b-fc6d-4873-82e2-b63fcd729fac service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:02 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-a7b1db2b-c379-4a97-934f-2dd57e554c02 req-9747c08b-fc6d-4873-82e2-b63fcd729fac service nova] Creating event network-vif-unplugged:90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 for instance b0c707ac-b08f-4f18-8262-e1b79d7e17e1 on user Apr 17 10:42:02 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-a7b1db2b-c379-4a97-934f-2dd57e554c02 req-9747c08b-fc6d-4873-82e2-b63fcd729fac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042137 Apr 17 10:42:02 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 139/441] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:42:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 10:42:03 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1486235308", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "7f2d57e1-037c-452b-ad18-1257d186c845"}], "security_groups": [{"name": "tempest-securitygroup--1157679240"}], "key_name": "tempest-keypair-1963349943", "user_data": "}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:42:03 user devstack@n-api.service[72743]: DEBUG nova.network.neutron [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] validate_networks() for [('7f2d57e1-037c-452b-ad18-1257d186c845', None, None, None, None, None)] {{(pid=72743) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:42:03 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-443055bc-1f50-40a1-b915-5e23c6572d8d req-a7419df7-bdb5-4fe7-9211-e603c7c8d1a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c707ac-b08f-4f18-8262-e1b79d7e17e1", "name": "network-vif-deleted", "tag": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:42:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-443055bc-1f50-40a1-b915-5e23c6572d8d req-a7419df7-bdb5-4fe7-9211-e603c7c8d1a8 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-443055bc-1f50-40a1-b915-5e23c6572d8d req-a7419df7-bdb5-4fe7-9211-e603c7c8d1a8 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-443055bc-1f50-40a1-b915-5e23c6572d8d req-a7419df7-bdb5-4fe7-9211-e603c7c8d1a8 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:03 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-443055bc-1f50-40a1-b915-5e23c6572d8d req-a7419df7-bdb5-4fe7-9211-e603c7c8d1a8 service nova] Creating event network-vif-deleted:90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 for instance b0c707ac-b08f-4f18-8262-e1b79d7e17e1 on user Apr 17 10:42:03 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-443055bc-1f50-40a1-b915-5e23c6572d8d req-a7419df7-bdb5-4fe7-9211-e603c7c8d1a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033899 Apr 17 10:42:03 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 153/442] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:42:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:42:03 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-030ead00-66ba-4878-94d4-e208c6d4390f tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Calling method '.version_select at 0x7fc55a976ef0>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:42:04 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-7a8c41ba-03d1-4e5e-8590-15b62c2c5d3f req-70641d0f-b939-45e2-865d-382e12335a51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c707ac-b08f-4f18-8262-e1b79d7e17e1", "name": "network-vif-plugged", "status": "completed", "tag": "90c85bb7-50e1-4c86-9c1f-e27f14fb50d3"}, {"server_uuid": "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab", "name": "network-vif-unplugged", "status": "completed", "tag": "2acfe658-2dce-4086-b24a-ef0b4c3714f8"}, {"server_uuid": "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab", "name": "network-vif-plugged", "status": "completed", "tag": "2acfe658-2dce-4086-b24a-ef0b4c3714f8"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:42:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-7a8c41ba-03d1-4e5e-8590-15b62c2c5d3f req-70641d0f-b939-45e2-865d-382e12335a51 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-7a8c41ba-03d1-4e5e-8590-15b62c2c5d3f req-70641d0f-b939-45e2-865d-382e12335a51 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-7a8c41ba-03d1-4e5e-8590-15b62c2c5d3f req-70641d0f-b939-45e2-865d-382e12335a51 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:04 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-7a8c41ba-03d1-4e5e-8590-15b62c2c5d3f req-70641d0f-b939-45e2-865d-382e12335a51 service nova] Creating event network-vif-plugged:90c85bb7-50e1-4c86-9c1f-e27f14fb50d3 for instance b0c707ac-b08f-4f18-8262-e1b79d7e17e1 on user Apr 17 10:42:04 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-7a8c41ba-03d1-4e5e-8590-15b62c2c5d3f req-70641d0f-b939-45e2-865d-382e12335a51 service nova] Creating event network-vif-unplugged:2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab on user Apr 17 10:42:04 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-7a8c41ba-03d1-4e5e-8590-15b62c2c5d3f req-70641d0f-b939-45e2-865d-382e12335a51 service nova] Creating event network-vif-plugged:2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab on user Apr 17 10:42:04 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-7a8c41ba-03d1-4e5e-8590-15b62c2c5d3f req-70641d0f-b939-45e2-865d-382e12335a51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.059307 Apr 17 10:42:04 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 154/443] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:42:04 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 10:42:04 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-030ead00-66ba-4878-94d4-e208c6d4390f tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/1d484d43-a1db-4806-ae9e-7be2347dbfec" status: 204 len: 0 microversion: 2.1 time: 0.278392 Apr 17 10:42:04 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 140/444] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:42:03 2023] DELETE /compute/v2.1/images/1d484d43-a1db-4806-ae9e-7be2347dbfec => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 17 10:42:04 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:42:04 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:42:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:04 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Going to try to terminate instance {{(pid=72745) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:42:04 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-e0b87e5f-6796-4bb4-a54f-1f68b2ace6f7 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" status: 204 len: 0 microversion: 2.1 time: 0.148212 Apr 17 10:42:04 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 155/445] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:42:04 2023] DELETE /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:42:04 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Flavor limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:42:04 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Image limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:42:04 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Flavor pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:42:04 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Image pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:42:04 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:42:04 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-130c1439-68f4-4ce0-9e02-bd279a035a5d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:42:04 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-130c1439-68f4-4ce0-9e02-bd279a035a5d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:42:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-130c1439-68f4-4ce0-9e02-bd279a035a5d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-130c1439-68f4-4ce0-9e02-bd279a035a5d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-130c1439-68f4-4ce0-9e02-bd279a035a5d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-130c1439-68f4-4ce0-9e02-bd279a035a5d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-130c1439-68f4-4ce0-9e02-bd279a035a5d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-130c1439-68f4-4ce0-9e02-bd279a035a5d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:04 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Getting quotas for project e6dac880f4294283ae7838bfa0edf5c1. Resources: {'cores', 'instances', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:42:04 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Getting quotas for user aea97828312f45ffa1b7148c375a7f9a and project e6dac880f4294283ae7838bfa0edf5c1. Resources: {'cores', 'instances', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:42:04 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Going to run 1 instances... {{(pid=72743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:42:04 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:42:04 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-6664a0e5-bff4-4b39-8f9f-561b3f75cdba tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.960701 Apr 17 10:42:04 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 151/446] 10.0.0.210 () {66 vars in 1265 bytes} [Mon Apr 17 10:42:03 2023] POST /compute/v2.1/servers => generated 400 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 17 10:42:04 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-3ec807e5-4b67-4b1d-abeb-aa7516f46a04 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:42:04 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-3ec807e5-4b67-4b1d-abeb-aa7516f46a04 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:42:04 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-3ec807e5-4b67-4b1d-abeb-aa7516f46a04 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:42:04 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-3ec807e5-4b67-4b1d-abeb-aa7516f46a04 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:42:04 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-3ec807e5-4b67-4b1d-abeb-aa7516f46a04 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:42:04 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-3ec807e5-4b67-4b1d-abeb-aa7516f46a04 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b" status: 200 len: 1276 microversion: 2.20 time: 0.130070 Apr 17 10:42:04 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 156/447] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:42:04 2023] GET /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b => generated 1276 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:42:04 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-130c1439-68f4-4ce0-9e02-bd279a035a5d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282298df65264595b5d7351066128b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850462faec874544bdc01dd14746d558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:42:04 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-130c1439-68f4-4ce0-9e02-bd279a035a5d tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" status: 200 len: 1675 microversion: 2.1 time: 0.463428 Apr 17 10:42:04 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 141/448] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:42:04 2023] GET /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 => generated 1675 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:42:05 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-0ed0b5f3-46f5-4dcc-8be0-19330a373291 req-85dcc934-dea8-472a-99a3-25860f802320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4", "name": "network-vif-unplugged", "status": "completed", "tag": "f839dea5-4294-4842-bfa2-262351dabfb9"}, {"server_uuid": "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4", "name": "network-vif-plugged", "status": "completed", "tag": "f839dea5-4294-4842-bfa2-262351dabfb9"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:42:05 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-0ed0b5f3-46f5-4dcc-8be0-19330a373291 req-85dcc934-dea8-472a-99a3-25860f802320 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:05 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-0ed0b5f3-46f5-4dcc-8be0-19330a373291 req-85dcc934-dea8-472a-99a3-25860f802320 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:05 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-0ed0b5f3-46f5-4dcc-8be0-19330a373291 req-85dcc934-dea8-472a-99a3-25860f802320 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:05 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-0ed0b5f3-46f5-4dcc-8be0-19330a373291 req-85dcc934-dea8-472a-99a3-25860f802320 service nova] Creating event network-vif-unplugged:f839dea5-4294-4842-bfa2-262351dabfb9 for instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 on user Apr 17 10:42:05 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-0ed0b5f3-46f5-4dcc-8be0-19330a373291 req-85dcc934-dea8-472a-99a3-25860f802320 service nova] Creating event network-vif-plugged:f839dea5-4294-4842-bfa2-262351dabfb9 for instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 on user Apr 17 10:42:05 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-0ed0b5f3-46f5-4dcc-8be0-19330a373291 req-85dcc934-dea8-472a-99a3-25860f802320 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.038223 Apr 17 10:42:05 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 152/449] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:42:05 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:42:06 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-bc231b74-055e-44f2-9d86-7be10efff373 req-57db8fc6-3ec8-4a35-9997-01570e6b5bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab", "name": "network-vif-plugged", "status": "completed", "tag": "2acfe658-2dce-4086-b24a-ef0b4c3714f8"}, {"server_uuid": "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab", "name": "network-vif-plugged", "status": "completed", "tag": "2acfe658-2dce-4086-b24a-ef0b4c3714f8"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:42:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-bc231b74-055e-44f2-9d86-7be10efff373 req-57db8fc6-3ec8-4a35-9997-01570e6b5bc2 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-bc231b74-055e-44f2-9d86-7be10efff373 req-57db8fc6-3ec8-4a35-9997-01570e6b5bc2 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-bc231b74-055e-44f2-9d86-7be10efff373 req-57db8fc6-3ec8-4a35-9997-01570e6b5bc2 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:06 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-bc231b74-055e-44f2-9d86-7be10efff373 req-57db8fc6-3ec8-4a35-9997-01570e6b5bc2 service nova] Creating event network-vif-plugged:2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab on user Apr 17 10:42:06 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-bc231b74-055e-44f2-9d86-7be10efff373 req-57db8fc6-3ec8-4a35-9997-01570e6b5bc2 service nova] Creating event network-vif-plugged:2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab on user Apr 17 10:42:06 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-bc231b74-055e-44f2-9d86-7be10efff373 req-57db8fc6-3ec8-4a35-9997-01570e6b5bc2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047745 Apr 17 10:42:06 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 157/450] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:42:06 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:42:08 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-ecfafbb3-5844-40e7-9ac2-483d461113ab req-33aef7a3-cc9f-4c8c-b886-77c100d64bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b1074e-7352-437a-b2ec-1eaefc5bf1b4", "name": "network-vif-deleted", "tag": "f839dea5-4294-4842-bfa2-262351dabfb9"}, {"name": "network-changed", "server_uuid": "288bc9dc-1698-4ca9-a670-5e219c04202b", "tag": "8541d98c-fcb7-4f1a-904c-97db8145dd29"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:42:08 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-ecfafbb3-5844-40e7-9ac2-483d461113ab req-33aef7a3-cc9f-4c8c-b886-77c100d64bd9 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:08 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-ecfafbb3-5844-40e7-9ac2-483d461113ab req-33aef7a3-cc9f-4c8c-b886-77c100d64bd9 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:08 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-ecfafbb3-5844-40e7-9ac2-483d461113ab req-33aef7a3-cc9f-4c8c-b886-77c100d64bd9 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:08 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-ecfafbb3-5844-40e7-9ac2-483d461113ab req-33aef7a3-cc9f-4c8c-b886-77c100d64bd9 service nova] Creating event network-vif-deleted:f839dea5-4294-4842-bfa2-262351dabfb9 for instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 on user Apr 17 10:42:08 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-ecfafbb3-5844-40e7-9ac2-483d461113ab req-33aef7a3-cc9f-4c8c-b886-77c100d64bd9 service nova] Creating event network-changed:8541d98c-fcb7-4f1a-904c-97db8145dd29 for instance 288bc9dc-1698-4ca9-a670-5e219c04202b on user Apr 17 10:42:08 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-ecfafbb3-5844-40e7-9ac2-483d461113ab req-33aef7a3-cc9f-4c8c-b886-77c100d64bd9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.047179 Apr 17 10:42:08 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 142/451] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:42:08 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:42:10 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-f5bec032-5c48-4c56-b33a-7187329459ac req-5cb8fcfe-5feb-4a0d-8c2b-5db70c71b99a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "288bc9dc-1698-4ca9-a670-5e219c04202b", "name": "network-vif-plugged", "status": "completed", "tag": "8541d98c-fcb7-4f1a-904c-97db8145dd29"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:42:10 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-f5bec032-5c48-4c56-b33a-7187329459ac req-5cb8fcfe-5feb-4a0d-8c2b-5db70c71b99a service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:10 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-f5bec032-5c48-4c56-b33a-7187329459ac req-5cb8fcfe-5feb-4a0d-8c2b-5db70c71b99a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:10 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-f5bec032-5c48-4c56-b33a-7187329459ac req-5cb8fcfe-5feb-4a0d-8c2b-5db70c71b99a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:10 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-f5bec032-5c48-4c56-b33a-7187329459ac req-5cb8fcfe-5feb-4a0d-8c2b-5db70c71b99a service nova] Creating event network-vif-plugged:8541d98c-fcb7-4f1a-904c-97db8145dd29 for instance 288bc9dc-1698-4ca9-a670-5e219c04202b on user Apr 17 10:42:10 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-f5bec032-5c48-4c56-b33a-7187329459ac req-5cb8fcfe-5feb-4a0d-8c2b-5db70c71b99a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037184 Apr 17 10:42:10 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 153/452] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:42:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:42:12 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-c74aa686-ccae-4771-a286-2e4c3b195f71 req-2fe711c7-a16d-4929-b964-92f892e80a4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "288bc9dc-1698-4ca9-a670-5e219c04202b", "name": "network-vif-plugged", "status": "completed", "tag": "8541d98c-fcb7-4f1a-904c-97db8145dd29"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:42:12 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-c74aa686-ccae-4771-a286-2e4c3b195f71 req-2fe711c7-a16d-4929-b964-92f892e80a4b service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:12 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-c74aa686-ccae-4771-a286-2e4c3b195f71 req-2fe711c7-a16d-4929-b964-92f892e80a4b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:12 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-c74aa686-ccae-4771-a286-2e4c3b195f71 req-2fe711c7-a16d-4929-b964-92f892e80a4b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:12 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-c74aa686-ccae-4771-a286-2e4c3b195f71 req-2fe711c7-a16d-4929-b964-92f892e80a4b service nova] Creating event network-vif-plugged:8541d98c-fcb7-4f1a-904c-97db8145dd29 for instance 288bc9dc-1698-4ca9-a670-5e219c04202b on user Apr 17 10:42:12 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-c74aa686-ccae-4771-a286-2e4c3b195f71 req-2fe711c7-a16d-4929-b964-92f892e80a4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032945 Apr 17 10:42:12 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 158/453] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:42:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:42:13 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=4 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:42:13 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-2ecbd158-e53b-4150-ad6a-a39afd003837 req-e0dc1dd5-a300-466b-8b85-b66b55956ffc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7792cf72-dc73-4201-9501-4515ce860735", "tag": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:42:13 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-2ecbd158-e53b-4150-ad6a-a39afd003837 req-e0dc1dd5-a300-466b-8b85-b66b55956ffc service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:13 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-2ecbd158-e53b-4150-ad6a-a39afd003837 req-e0dc1dd5-a300-466b-8b85-b66b55956ffc service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:13 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-2ecbd158-e53b-4150-ad6a-a39afd003837 req-e0dc1dd5-a300-466b-8b85-b66b55956ffc service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:13 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-2ecbd158-e53b-4150-ad6a-a39afd003837 req-e0dc1dd5-a300-466b-8b85-b66b55956ffc service nova] Creating event network-changed:7d50333e-fed3-47d0-9aaf-bd1ab7238d62 for instance 7792cf72-dc73-4201-9501-4515ce860735 on user Apr 17 10:42:13 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-2ecbd158-e53b-4150-ad6a-a39afd003837 req-e0dc1dd5-a300-466b-8b85-b66b55956ffc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062808 Apr 17 10:42:13 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 143/454] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:42:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:42:16 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-5d4c560b-e101-4b68-a392-4501727ff189 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:42:16 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-5d4c560b-e101-4b68-a392-4501727ff189 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:42:16 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:42:16 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:42:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5d4c560b-e101-4b68-a392-4501727ff189 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5d4c560b-e101-4b68-a392-4501727ff189 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5d4c560b-e101-4b68-a392-4501727ff189 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5d4c560b-e101-4b68-a392-4501727ff189 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5d4c560b-e101-4b68-a392-4501727ff189 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5d4c560b-e101-4b68-a392-4501727ff189 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:16 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-5d4c560b-e101-4b68-a392-4501727ff189 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69d4d16a4bc479ba2a8a80f359135f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33eedb851ee244768016f5bf203d2f9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:42:16 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-5d4c560b-e101-4b68-a392-4501727ff189 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4" status: 200 len: 1496 microversion: 2.1 time: 0.262653 Apr 17 10:42:16 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 154/455] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:42:16 2023] GET /compute/v2.1/servers/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4 => generated 1496 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:42:17 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:42:17 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:42:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:17 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Going to try to start instance {{(pid=72745) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 17 10:42:17 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-bd0e5192-f2e7-4e5b-8acf-38b9c6349b08 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "POST /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99/action" status: 202 len: 0 microversion: 2.1 time: 0.112278 Apr 17 10:42:17 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 159/456] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 10:42:17 2023] POST /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:42:17 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-67964640-e41e-4d9f-a4d5-b83c19649a6c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:42:17 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-67964640-e41e-4d9f-a4d5-b83c19649a6c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:42:17 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-67964640-e41e-4d9f-a4d5-b83c19649a6c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:17 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-67964640-e41e-4d9f-a4d5-b83c19649a6c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:17 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-67964640-e41e-4d9f-a4d5-b83c19649a6c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:17 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-67964640-e41e-4d9f-a4d5-b83c19649a6c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:17 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-67964640-e41e-4d9f-a4d5-b83c19649a6c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:17 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-67964640-e41e-4d9f-a4d5-b83c19649a6c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:17 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:42:17 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:42:17 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:42:17 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:17 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:17 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:17 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:17 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:17 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:17 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:42:17 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Going to try to terminate instance {{(pid=72743) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:42:17 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-67964640-e41e-4d9f-a4d5-b83c19649a6c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9862432f87f4500a46f32a0b27d54d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a17ec3e1b314acbb701f2d2d27d0560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:42:17 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-67964640-e41e-4d9f-a4d5-b83c19649a6c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99" status: 200 len: 1648 microversion: 2.1 time: 0.338063 Apr 17 10:42:17 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 144/457] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:42:17 2023] GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99 => generated 1648 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:42:17 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-b1a4eb2c-7f13-498d-bbcc-833235e533f9 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735" status: 204 len: 0 microversion: 2.1 time: 0.150959 Apr 17 10:42:17 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 155/458] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:42:17 2023] DELETE /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:42:17 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-69763217-2cbf-41d8-8b8f-58ae203a17fc tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:42:17 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-69763217-2cbf-41d8-8b8f-58ae203a17fc tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:42:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-69763217-2cbf-41d8-8b8f-58ae203a17fc tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-69763217-2cbf-41d8-8b8f-58ae203a17fc tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-69763217-2cbf-41d8-8b8f-58ae203a17fc tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-69763217-2cbf-41d8-8b8f-58ae203a17fc tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-69763217-2cbf-41d8-8b8f-58ae203a17fc tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-69763217-2cbf-41d8-8b8f-58ae203a17fc tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:18 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-69763217-2cbf-41d8-8b8f-58ae203a17fc tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea177954e75a45f7ad7c9831ab55375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0c657dc95549a3a3ce94f35bfa91be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:42:18 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-69763217-2cbf-41d8-8b8f-58ae203a17fc tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735" status: 200 len: 1570 microversion: 2.1 time: 0.269785 Apr 17 10:42:18 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 160/459] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:42:17 2023] GET /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735 => generated 1570 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:42:18 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-9363c5fa-b4cd-4980-be92-8d56ed6e2436 req-b6642eb3-c209-4d6c-8068-9ce374486853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7792cf72-dc73-4201-9501-4515ce860735", "name": "network-vif-unplugged", "status": "completed", "tag": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:42:18 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:42:18 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-9363c5fa-b4cd-4980-be92-8d56ed6e2436 req-b6642eb3-c209-4d6c-8068-9ce374486853 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:18 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-9363c5fa-b4cd-4980-be92-8d56ed6e2436 req-b6642eb3-c209-4d6c-8068-9ce374486853 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:18 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-9363c5fa-b4cd-4980-be92-8d56ed6e2436 req-b6642eb3-c209-4d6c-8068-9ce374486853 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:18 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=27 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:42:18 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-9363c5fa-b4cd-4980-be92-8d56ed6e2436 req-b6642eb3-c209-4d6c-8068-9ce374486853 service nova] Creating event network-vif-unplugged:7d50333e-fed3-47d0-9aaf-bd1ab7238d62 for instance 7792cf72-dc73-4201-9501-4515ce860735 on user Apr 17 10:42:18 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-9363c5fa-b4cd-4980-be92-8d56ed6e2436 req-b6642eb3-c209-4d6c-8068-9ce374486853 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033986 Apr 17 10:42:18 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 145/460] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:42:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:42:20 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7792cf72-dc73-4201-9501-4515ce860735", "name": "network-vif-plugged", "status": "completed", "tag": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62"}, {"server_uuid": "7792cf72-dc73-4201-9501-4515ce860735", "name": "network-vif-plugged", "status": "completed", "tag": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62"}, {"server_uuid": "7792cf72-dc73-4201-9501-4515ce860735", "name": "network-vif-plugged", "status": "completed", "tag": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62"}, {"server_uuid": "7792cf72-dc73-4201-9501-4515ce860735", "name": "network-vif-unplugged", "status": "completed", "tag": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62"}, {"server_uuid": "7792cf72-dc73-4201-9501-4515ce860735", "name": "network-vif-plugged", "status": "completed", "tag": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62"}, {"server_uuid": "7792cf72-dc73-4201-9501-4515ce860735", "name": "network-vif-deleted", "tag": "7d50333e-fed3-47d0-9aaf-bd1ab7238d62"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:42:20 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:20 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:20 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:20 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] Creating event network-vif-plugged:7d50333e-fed3-47d0-9aaf-bd1ab7238d62 for instance 7792cf72-dc73-4201-9501-4515ce860735 on user Apr 17 10:42:20 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] Creating event network-vif-plugged:7d50333e-fed3-47d0-9aaf-bd1ab7238d62 for instance 7792cf72-dc73-4201-9501-4515ce860735 on user Apr 17 10:42:20 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] Creating event network-vif-plugged:7d50333e-fed3-47d0-9aaf-bd1ab7238d62 for instance 7792cf72-dc73-4201-9501-4515ce860735 on user Apr 17 10:42:20 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] Creating event network-vif-unplugged:7d50333e-fed3-47d0-9aaf-bd1ab7238d62 for instance 7792cf72-dc73-4201-9501-4515ce860735 on user Apr 17 10:42:20 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] Creating event network-vif-plugged:7d50333e-fed3-47d0-9aaf-bd1ab7238d62 for instance 7792cf72-dc73-4201-9501-4515ce860735 on user Apr 17 10:42:20 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] Creating event network-vif-deleted:7d50333e-fed3-47d0-9aaf-bd1ab7238d62 for instance 7792cf72-dc73-4201-9501-4515ce860735 on user Apr 17 10:42:20 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-b06a2156-2b93-456d-8982-1af8da60a758 req-e69e1cb1-9131-4133-ae66-0665212d6687 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.042718 Apr 17 10:42:20 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 156/461] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:42:20 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:42:22 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-fceada6e-6934-4f37-978c-7f5b39e630e9 req-1ece83de-6d8b-497a-80c6-8d9c4224be80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59fd26de-d46e-4f41-91f6-090005a07d99", "name": "network-vif-plugged", "status": "completed", "tag": "7124043d-665c-4a42-a041-b91ccc237b63"}, {"server_uuid": "59fd26de-d46e-4f41-91f6-090005a07d99", "name": "network-vif-plugged", "status": "completed", "tag": "7124043d-665c-4a42-a041-b91ccc237b63"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:42:22 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:42:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-fceada6e-6934-4f37-978c-7f5b39e630e9 req-1ece83de-6d8b-497a-80c6-8d9c4224be80 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-fceada6e-6934-4f37-978c-7f5b39e630e9 req-1ece83de-6d8b-497a-80c6-8d9c4224be80 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-fceada6e-6934-4f37-978c-7f5b39e630e9 req-1ece83de-6d8b-497a-80c6-8d9c4224be80 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:22 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:42:22 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-fceada6e-6934-4f37-978c-7f5b39e630e9 req-1ece83de-6d8b-497a-80c6-8d9c4224be80 service nova] Creating event network-vif-plugged:7124043d-665c-4a42-a041-b91ccc237b63 for instance 59fd26de-d46e-4f41-91f6-090005a07d99 on user Apr 17 10:42:22 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-fceada6e-6934-4f37-978c-7f5b39e630e9 req-1ece83de-6d8b-497a-80c6-8d9c4224be80 service nova] Creating event network-vif-plugged:7124043d-665c-4a42-a041-b91ccc237b63 for instance 59fd26de-d46e-4f41-91f6-090005a07d99 on user Apr 17 10:42:22 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-fceada6e-6934-4f37-978c-7f5b39e630e9 req-1ece83de-6d8b-497a-80c6-8d9c4224be80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046640 Apr 17 10:42:22 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 161/462] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:42:22 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:42:26 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1133781509", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "networks": [{"uuid": "a617c444-412d-4406-abf8-e1e2f697247e"}]}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:42:26 user devstack@n-api.service[72744]: DEBUG nova.network.neutron [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] validate_networks() for [('a617c444-412d-4406-abf8-e1e2f697247e', None, None, None, None, None)] {{(pid=72744) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:42:26 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Flavor limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:42:26 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Image limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:42:26 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Flavor pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:42:26 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Image pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:42:26 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:42:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:26 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Getting quotas for project b309bb2b37284020b81369ec89397374. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:42:26 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Getting quotas for user ae91492cb6f342f58e250622e2a3ac11 and project b309bb2b37284020b81369ec89397374. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:42:26 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Going to run 1 instances... {{(pid=72744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:42:26 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:42:26 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-eda9e005-53a2-4e96-bd61-616636b8ddc8 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.618570 Apr 17 10:42:26 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 146/463] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:42:26 2023] POST /compute/v2.1/servers => generated 378 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 10:42:26 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b5de6532-f5bb-4422-bd59-cc8483618de0 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:42:26 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-b5de6532-f5bb-4422-bd59-cc8483618de0 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:42:26 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-b5de6532-f5bb-4422-bd59-cc8483618de0 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae91492cb6f342f58e250622e2a3ac11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b309bb2b37284020b81369ec89397374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:42:26 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-b5de6532-f5bb-4422-bd59-cc8483618de0 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3e07a35c-b5cc-46df-8e83-21664fb83896" status: 200 len: 1208 microversion: 2.1 time: 0.073187 Apr 17 10:42:26 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 157/464] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:42:26 2023] GET /compute/v2.1/servers/3e07a35c-b5cc-46df-8e83-21664fb83896 => generated 1208 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:42:29 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-8a64cf12-4900-48ee-b79f-08ba3a901f58 req-55528359-2876-4b3e-a388-6b9f5a732c53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e07a35c-b5cc-46df-8e83-21664fb83896", "tag": "bc335a40-eaf8-46de-a9fe-8bcd2052b126"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:42:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-8a64cf12-4900-48ee-b79f-08ba3a901f58 req-55528359-2876-4b3e-a388-6b9f5a732c53 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-8a64cf12-4900-48ee-b79f-08ba3a901f58 req-55528359-2876-4b3e-a388-6b9f5a732c53 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-8a64cf12-4900-48ee-b79f-08ba3a901f58 req-55528359-2876-4b3e-a388-6b9f5a732c53 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:29 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-8a64cf12-4900-48ee-b79f-08ba3a901f58 req-55528359-2876-4b3e-a388-6b9f5a732c53 service nova] Creating event network-changed:bc335a40-eaf8-46de-a9fe-8bcd2052b126 for instance 3e07a35c-b5cc-46df-8e83-21664fb83896 on user Apr 17 10:42:29 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-8a64cf12-4900-48ee-b79f-08ba3a901f58 req-55528359-2876-4b3e-a388-6b9f5a732c53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039321 Apr 17 10:42:29 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 162/465] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:42:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:42:31 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-d135e196-45c5-47f0-9220-3b7cc972d5b8 req-6b11fcd5-c8ad-4747-8122-1cd75457fa0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e07a35c-b5cc-46df-8e83-21664fb83896", "name": "network-vif-plugged", "status": "completed", "tag": "bc335a40-eaf8-46de-a9fe-8bcd2052b126"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:42:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-d135e196-45c5-47f0-9220-3b7cc972d5b8 req-6b11fcd5-c8ad-4747-8122-1cd75457fa0e service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-d135e196-45c5-47f0-9220-3b7cc972d5b8 req-6b11fcd5-c8ad-4747-8122-1cd75457fa0e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-d135e196-45c5-47f0-9220-3b7cc972d5b8 req-6b11fcd5-c8ad-4747-8122-1cd75457fa0e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:31 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-d135e196-45c5-47f0-9220-3b7cc972d5b8 req-6b11fcd5-c8ad-4747-8122-1cd75457fa0e service nova] Creating event network-vif-plugged:bc335a40-eaf8-46de-a9fe-8bcd2052b126 for instance 3e07a35c-b5cc-46df-8e83-21664fb83896 on user Apr 17 10:42:31 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-d135e196-45c5-47f0-9220-3b7cc972d5b8 req-6b11fcd5-c8ad-4747-8122-1cd75457fa0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033520 Apr 17 10:42:31 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 147/466] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:42:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:42:33 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-894b46b1-c2cf-4224-b27c-722b671d92bb req-0f7ec047-c80f-4197-b4e3-5d55ae9b03f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e07a35c-b5cc-46df-8e83-21664fb83896", "name": "network-vif-plugged", "status": "completed", "tag": "bc335a40-eaf8-46de-a9fe-8bcd2052b126"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:42:33 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:42:33 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-894b46b1-c2cf-4224-b27c-722b671d92bb req-0f7ec047-c80f-4197-b4e3-5d55ae9b03f0 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:33 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-894b46b1-c2cf-4224-b27c-722b671d92bb req-0f7ec047-c80f-4197-b4e3-5d55ae9b03f0 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:33 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-894b46b1-c2cf-4224-b27c-722b671d92bb req-0f7ec047-c80f-4197-b4e3-5d55ae9b03f0 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:33 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-894b46b1-c2cf-4224-b27c-722b671d92bb req-0f7ec047-c80f-4197-b4e3-5d55ae9b03f0 service nova] Creating event network-vif-plugged:bc335a40-eaf8-46de-a9fe-8bcd2052b126 for instance 3e07a35c-b5cc-46df-8e83-21664fb83896 on user Apr 17 10:42:33 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-894b46b1-c2cf-4224-b27c-722b671d92bb req-0f7ec047-c80f-4197-b4e3-5d55ae9b03f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043699 Apr 17 10:42:33 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 158/467] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:42:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 10:42:47 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:42:47 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:42:47 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=3 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:42:47 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=3 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:42:47 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:47 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:47 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:47 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:47 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:47 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:47 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Going to try to terminate instance {{(pid=72745) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:42:47 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-47cf4337-192e-4b47-b0a2-5d7b84c27ae1 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b0a9753b-207e-4c23-9fea-f7dc89a5edf7" status: 204 len: 0 microversion: 2.1 time: 0.154362 Apr 17 10:42:47 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 163/468] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:42:47 2023] DELETE /compute/v2.1/servers/b0a9753b-207e-4c23-9fea-f7dc89a5edf7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:42:47 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-13b2435b-f4c9-450a-993c-1a523d40b89d tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:42:47 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-13b2435b-f4c9-450a-993c-1a523d40b89d tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:42:47 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:42:47 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:42:47 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=3 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:42:47 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=5 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:42:47 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-13b2435b-f4c9-450a-993c-1a523d40b89d tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:47 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-13b2435b-f4c9-450a-993c-1a523d40b89d tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:47 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-13b2435b-f4c9-450a-993c-1a523d40b89d tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:47 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-13b2435b-f4c9-450a-993c-1a523d40b89d tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:47 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-13b2435b-f4c9-450a-993c-1a523d40b89d tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:47 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-13b2435b-f4c9-450a-993c-1a523d40b89d tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:47 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-13b2435b-f4c9-450a-993c-1a523d40b89d tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e61a5e172c34636b183ef9c84b714d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b831c3b6c244dda1821583a6b8cd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:42:47 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-13b2435b-f4c9-450a-993c-1a523d40b89d tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0a9753b-207e-4c23-9fea-f7dc89a5edf7" status: 200 len: 1499 microversion: 2.1 time: 0.333218 Apr 17 10:42:47 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 148/469] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:42:47 2023] GET /compute/v2.1/servers/b0a9753b-207e-4c23-9fea-f7dc89a5edf7 => generated 1499 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:42:48 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:42:48 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:42:48 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-6f744b0e-1417-442c-8849-4e4e6e4a8b64 req-865f30bb-9abc-45c9-8465-856750873263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a9753b-207e-4c23-9fea-f7dc89a5edf7", "name": "network-vif-unplugged", "status": "completed", "tag": "6fac7ecb-de62-4a89-b509-210fa4bedd43"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:42:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-6f744b0e-1417-442c-8849-4e4e6e4a8b64 req-865f30bb-9abc-45c9-8465-856750873263 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-6f744b0e-1417-442c-8849-4e4e6e4a8b64 req-865f30bb-9abc-45c9-8465-856750873263 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-6f744b0e-1417-442c-8849-4e4e6e4a8b64 req-865f30bb-9abc-45c9-8465-856750873263 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:48 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-6f744b0e-1417-442c-8849-4e4e6e4a8b64 req-865f30bb-9abc-45c9-8465-856750873263 service nova] Creating event network-vif-unplugged:6fac7ecb-de62-4a89-b509-210fa4bedd43 for instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7 on user Apr 17 10:42:48 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-6f744b0e-1417-442c-8849-4e4e6e4a8b64 req-865f30bb-9abc-45c9-8465-856750873263 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053171 Apr 17 10:42:48 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 159/470] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:42:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:42:48 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-8814a307-ee2d-410d-88a0-9e8bd838aa63 req-11272808-52c8-47b2-971b-ef3db6698cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a9753b-207e-4c23-9fea-f7dc89a5edf7", "name": "network-vif-deleted", "tag": "6fac7ecb-de62-4a89-b509-210fa4bedd43"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:42:48 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-8814a307-ee2d-410d-88a0-9e8bd838aa63 req-11272808-52c8-47b2-971b-ef3db6698cc7 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:48 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-8814a307-ee2d-410d-88a0-9e8bd838aa63 req-11272808-52c8-47b2-971b-ef3db6698cc7 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:48 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-8814a307-ee2d-410d-88a0-9e8bd838aa63 req-11272808-52c8-47b2-971b-ef3db6698cc7 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:48 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-8814a307-ee2d-410d-88a0-9e8bd838aa63 req-11272808-52c8-47b2-971b-ef3db6698cc7 service nova] Creating event network-vif-deleted:6fac7ecb-de62-4a89-b509-210fa4bedd43 for instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7 on user Apr 17 10:42:48 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-8814a307-ee2d-410d-88a0-9e8bd838aa63 req-11272808-52c8-47b2-971b-ef3db6698cc7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042905 Apr 17 10:42:48 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 164/471] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:42:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:42:50 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-4005309d-a031-4649-918f-9367d419f4bd req-6238db71-cecd-47d9-80ad-c76a7221495f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a9753b-207e-4c23-9fea-f7dc89a5edf7", "name": "network-vif-plugged", "status": "completed", "tag": "6fac7ecb-de62-4a89-b509-210fa4bedd43"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:42:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-4005309d-a031-4649-918f-9367d419f4bd req-6238db71-cecd-47d9-80ad-c76a7221495f service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-4005309d-a031-4649-918f-9367d419f4bd req-6238db71-cecd-47d9-80ad-c76a7221495f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-4005309d-a031-4649-918f-9367d419f4bd req-6238db71-cecd-47d9-80ad-c76a7221495f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:50 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-4005309d-a031-4649-918f-9367d419f4bd req-6238db71-cecd-47d9-80ad-c76a7221495f service nova] Creating event network-vif-plugged:6fac7ecb-de62-4a89-b509-210fa4bedd43 for instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7 on user Apr 17 10:42:50 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-4005309d-a031-4649-918f-9367d419f4bd req-6238db71-cecd-47d9-80ad-c76a7221495f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029687 Apr 17 10:42:50 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 149/472] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:42:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:42:51 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-80c98843-9ead-4990-a5f5-888bc2360b62 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:42:51 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-80c98843-9ead-4990-a5f5-888bc2360b62 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:42:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-80c98843-9ead-4990-a5f5-888bc2360b62 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-80c98843-9ead-4990-a5f5-888bc2360b62 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-80c98843-9ead-4990-a5f5-888bc2360b62 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-80c98843-9ead-4990-a5f5-888bc2360b62 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-80c98843-9ead-4990-a5f5-888bc2360b62 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-80c98843-9ead-4990-a5f5-888bc2360b62 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:51 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-80c98843-9ead-4990-a5f5-888bc2360b62 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:42:51 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-80c98843-9ead-4990-a5f5-888bc2360b62 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:42:51 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-80c98843-9ead-4990-a5f5-888bc2360b62 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:42:51 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-80c98843-9ead-4990-a5f5-888bc2360b62 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" status: 200 len: 1769 microversion: 2.87 time: 0.220890 Apr 17 10:42:51 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 160/473] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:42:50 2023] GET /compute/v2.1/servers/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab => generated 1769 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:42:52 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-b08080f0-04d8-436e-bb69-1bc0b28a4448 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:42:52 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-b08080f0-04d8-436e-bb69-1bc0b28a4448 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] [instance: b0c707ac-b08f-4f18-8262-e1b79d7e17e1] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:42:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b08080f0-04d8-436e-bb69-1bc0b28a4448 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b08080f0-04d8-436e-bb69-1bc0b28a4448 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b08080f0-04d8-436e-bb69-1bc0b28a4448 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b08080f0-04d8-436e-bb69-1bc0b28a4448 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b08080f0-04d8-436e-bb69-1bc0b28a4448 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b08080f0-04d8-436e-bb69-1bc0b28a4448 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:52 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-b08080f0-04d8-436e-bb69-1bc0b28a4448 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] HTTP exception thrown: Instance b0c707ac-b08f-4f18-8262-e1b79d7e17e1 could not be found. Apr 17 10:42:52 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-b08080f0-04d8-436e-bb69-1bc0b28a4448 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Request method failure captured: Apr 17 10:42:52 user devstack@n-api.service[72745]: request: GET /compute/v2.1/servers/b0c707ac-b08f-4f18-8262-e1b79d7e17e1 HTTP/1.1 Apr 17 10:42:52 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:42:52 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:42:52 user devstack@n-api.service[72745]: Connection: close Apr 17 10:42:52 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 10:42:52 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:42:52 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:42:52 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:42:52 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:42:52 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSEZ7kiFROmnwYNGv7ccCS69fEHxb2_5jBxDgcx2IZ3bDPrXjanSTSsexHrnJdSsEz4B9R8WnjcEpVlmp-TdMS4iURGdCbuTEBvigMFCz32F4SY7BLrkJvbXy7Yx0onWLGxY0OssleY3bskXE_SCoCwqKycPMaA_pcbf1uNVT5NLnMI Apr 17 10:42:52 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:42:52 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:42:52 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:42:52 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:42:52 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:42:52 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:42:52 user devstack@n-api.service[72745]: X-Project-Id: 5a793afb3e7045898c59a77975079d72 Apr 17 10:42:52 user devstack@n-api.service[72745]: X-Project-Name: tempest-TestShelveInstance-2028370832 Apr 17 10:42:52 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:42:52 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:42:52 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5a793afb3e7045898c59a77975079d72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5a793afb3e7045898c59a77975079d72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5a793afb3e7045898c59a77975079d72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:42:52 user devstack@n-api.service[72745]: X-Tenant: tempest-TestShelveInstance-2028370832 Apr 17 10:42:52 user devstack@n-api.service[72745]: X-Tenant-Id: 5a793afb3e7045898c59a77975079d72 Apr 17 10:42:52 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-TestShelveInstance-2028370832 Apr 17 10:42:52 user devstack@n-api.service[72745]: X-User: tempest-TestShelveInstance-2028370832-project-member Apr 17 10:42:52 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:42:52 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:42:52 user devstack@n-api.service[72745]: X-User-Id: b43c0aee7b05459d898e0dc2654262fa Apr 17 10:42:52 user devstack@n-api.service[72745]: X-User-Name: tempest-TestShelveInstance-2028370832-project-member Apr 17 10:42:52 user devstack@n-api.service[72745]: method: > Apr 17 10:42:52 user devstack@n-api.service[72745]: exception: Instance b0c707ac-b08f-4f18-8262-e1b79d7e17e1 could not be found. Apr 17 10:42:52 user devstack@n-api.service[72745]: action_args: {'id': 'b0c707ac-b08f-4f18-8262-e1b79d7e17e1'} Apr 17 10:42:52 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c707ac-b08f-4f18-8262-e1b79d7e17e1 could not be found. Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c707ac-b08f-4f18-8262-e1b79d7e17e1 could not be found. Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c707ac-b08f-4f18-8262-e1b79d7e17e1 could not be found. Apr 17 10:42:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:42:52 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-b08080f0-04d8-436e-bb69-1bc0b28a4448 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Returning 404 to user: Instance b0c707ac-b08f-4f18-8262-e1b79d7e17e1 could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:42:52 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-b08080f0-04d8-436e-bb69-1bc0b28a4448 tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0c707ac-b08f-4f18-8262-e1b79d7e17e1" status: 404 len: 111 microversion: 2.1 time: 0.030973 Apr 17 10:42:52 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 165/474] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:42:52 2023] GET /compute/v2.1/servers/b0c707ac-b08f-4f18-8262-e1b79d7e17e1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:42:52 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-6cd5a2d7-1670-4ea2-9a2a-87f1b42260fb tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] Calling method '.version_select at 0x7fc55a82da20>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:42:52 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-6cd5a2d7-1670-4ea2-9a2a-87f1b42260fb tempest-TestShelveInstance-2028370832 tempest-TestShelveInstance-2028370832-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-993329906" status: 202 len: 0 microversion: 2.1 time: 0.027334 Apr 17 10:42:52 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 150/475] 10.0.0.210 () {62 vars in 1328 bytes} [Mon Apr 17 10:42:52 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-993329906 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:42:54 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-7e155c24-b744-49a0-adac-4992e97f9721 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:42:54 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-7e155c24-b744-49a0-adac-4992e97f9721 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:42:54 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7e155c24-b744-49a0-adac-4992e97f9721 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:54 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7e155c24-b744-49a0-adac-4992e97f9721 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:54 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7e155c24-b744-49a0-adac-4992e97f9721 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:54 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7e155c24-b744-49a0-adac-4992e97f9721 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:54 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7e155c24-b744-49a0-adac-4992e97f9721 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:54 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7e155c24-b744-49a0-adac-4992e97f9721 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:54 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-2aa21c44-c4ae-4428-ac5f-8021de2afe2e tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:42:54 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-2aa21c44-c4ae-4428-ac5f-8021de2afe2e tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] [instance: e0b1074e-7352-437a-b2ec-1eaefc5bf1b4] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:42:54 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2aa21c44-c4ae-4428-ac5f-8021de2afe2e tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:54 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2aa21c44-c4ae-4428-ac5f-8021de2afe2e tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:54 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2aa21c44-c4ae-4428-ac5f-8021de2afe2e tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:54 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2aa21c44-c4ae-4428-ac5f-8021de2afe2e tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:42:54 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2aa21c44-c4ae-4428-ac5f-8021de2afe2e tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:42:54 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2aa21c44-c4ae-4428-ac5f-8021de2afe2e tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:42:54 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-2aa21c44-c4ae-4428-ac5f-8021de2afe2e tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] HTTP exception thrown: Instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 could not be found. Apr 17 10:42:54 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-2aa21c44-c4ae-4428-ac5f-8021de2afe2e tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Request method failure captured: Apr 17 10:42:54 user devstack@n-api.service[72745]: request: GET /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 HTTP/1.1 Apr 17 10:42:54 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:42:54 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:42:54 user devstack@n-api.service[72745]: Connection: close Apr 17 10:42:54 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 10:42:54 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:42:54 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:42:54 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:42:54 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:42:54 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSC89iN7IeOZuo-S0R9R8ejFxilsbcwaJRK1J2p36aCCHTxKakryzYVeKZ-R_De7D3Elao1nnFqP7ntH0AIjXh5oJK1F5PrUblwlezJodjDDSGiIy_tdw8xiIPMkyTB0OGrxqwpoXiyfrQ_EodLnuwtyEho13l3IxBZXIhu4J7F-8-w Apr 17 10:42:54 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:42:54 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:42:54 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:42:54 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:42:54 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:42:54 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:42:54 user devstack@n-api.service[72745]: X-Project-Id: 850462faec874544bdc01dd14746d558 Apr 17 10:42:54 user devstack@n-api.service[72745]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1756156966 Apr 17 10:42:54 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:42:54 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:42:54 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/850462faec874544bdc01dd14746d558"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/850462faec874544bdc01dd14746d558"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/850462faec874544bdc01dd14746d558"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:42:54 user devstack@n-api.service[72745]: X-Tenant: tempest-ServerStableDeviceRescueTest-1756156966 Apr 17 10:42:54 user devstack@n-api.service[72745]: X-Tenant-Id: 850462faec874544bdc01dd14746d558 Apr 17 10:42:54 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1756156966 Apr 17 10:42:54 user devstack@n-api.service[72745]: X-User: tempest-ServerStableDeviceRescueTest-1756156966-project-member Apr 17 10:42:54 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:42:54 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:42:54 user devstack@n-api.service[72745]: X-User-Id: 282298df65264595b5d7351066128b1a Apr 17 10:42:54 user devstack@n-api.service[72745]: X-User-Name: tempest-ServerStableDeviceRescueTest-1756156966-project-member Apr 17 10:42:54 user devstack@n-api.service[72745]: method: > Apr 17 10:42:54 user devstack@n-api.service[72745]: exception: Instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 could not be found. Apr 17 10:42:54 user devstack@n-api.service[72745]: action_args: {'id': 'e0b1074e-7352-437a-b2ec-1eaefc5bf1b4'} Apr 17 10:42:54 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 could not be found. Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 could not be found. Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 could not be found. Apr 17 10:42:54 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:42:54 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-2aa21c44-c4ae-4428-ac5f-8021de2afe2e tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Returning 404 to user: Instance e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:42:54 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-2aa21c44-c4ae-4428-ac5f-8021de2afe2e tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4" status: 404 len: 111 microversion: 2.1 time: 0.027709 Apr 17 10:42:54 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 166/476] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:42:54 2023] GET /compute/v2.1/servers/e0b1074e-7352-437a-b2ec-1eaefc5bf1b4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:42:54 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-7e155c24-b744-49a0-adac-4992e97f9721 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:42:54 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-3bbc917a-7a3f-42fa-a27e-bc93d61bb492 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] Calling method '.version_select at 0x7fc55a82f400>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:42:54 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-7e155c24-b744-49a0-adac-4992e97f9721 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:42:54 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-7e155c24-b744-49a0-adac-4992e97f9721 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:42:54 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-7e155c24-b744-49a0-adac-4992e97f9721 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b" status: 200 len: 1587 microversion: 2.20 time: 0.227377 Apr 17 10:42:54 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 161/477] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:42:54 2023] GET /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b => generated 1587 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:42:54 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-3bbc917a-7a3f-42fa-a27e-bc93d61bb492 tempest-ServerStableDeviceRescueTest-1756156966 tempest-ServerStableDeviceRescueTest-1756156966-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-690522544" status: 202 len: 0 microversion: 2.1 time: 0.037176 Apr 17 10:42:54 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 151/478] 10.0.0.210 () {62 vars in 1295 bytes} [Mon Apr 17 10:42:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-690522544 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:43:07 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-981fd3e2-f601-421d-a5b8-271cd62e3835 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:43:07 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-981fd3e2-f601-421d-a5b8-271cd62e3835 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:43:07 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:43:07 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:43:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-981fd3e2-f601-421d-a5b8-271cd62e3835 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-981fd3e2-f601-421d-a5b8-271cd62e3835 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-981fd3e2-f601-421d-a5b8-271cd62e3835 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-981fd3e2-f601-421d-a5b8-271cd62e3835 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-981fd3e2-f601-421d-a5b8-271cd62e3835 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-981fd3e2-f601-421d-a5b8-271cd62e3835 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:08 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-981fd3e2-f601-421d-a5b8-271cd62e3835 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9862432f87f4500a46f32a0b27d54d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a17ec3e1b314acbb701f2d2d27d0560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:43:08 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-981fd3e2-f601-421d-a5b8-271cd62e3835 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99" status: 200 len: 1652 microversion: 2.1 time: 0.227755 Apr 17 10:43:08 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 167/479] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:43:07 2023] GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99 => generated 1652 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:43:08 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-e94e852c-1ace-49ea-95b8-8bebf66b7ea6 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:43:08 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-e94e852c-1ace-49ea-95b8-8bebf66b7ea6 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] [instance: 7792cf72-dc73-4201-9501-4515ce860735] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:43:08 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=8 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:43:08 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=16 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:43:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e94e852c-1ace-49ea-95b8-8bebf66b7ea6 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e94e852c-1ace-49ea-95b8-8bebf66b7ea6 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e94e852c-1ace-49ea-95b8-8bebf66b7ea6 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e94e852c-1ace-49ea-95b8-8bebf66b7ea6 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e94e852c-1ace-49ea-95b8-8bebf66b7ea6 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e94e852c-1ace-49ea-95b8-8bebf66b7ea6 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:08 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-e94e852c-1ace-49ea-95b8-8bebf66b7ea6 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] HTTP exception thrown: Instance 7792cf72-dc73-4201-9501-4515ce860735 could not be found. Apr 17 10:43:08 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-e94e852c-1ace-49ea-95b8-8bebf66b7ea6 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Request method failure captured: Apr 17 10:43:08 user devstack@n-api.service[72743]: request: GET /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735 HTTP/1.1 Apr 17 10:43:08 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:43:08 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:43:08 user devstack@n-api.service[72743]: Connection: close Apr 17 10:43:08 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:43:08 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:43:08 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:43:08 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:43:08 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:43:08 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSDhFlFPO5eacl-zNBxVFqbv8XrEH2r2kDtZvq_Y_i-XC_703YcSYj1fX8586JHgCj-oiZmDu0Yb96tH5jpJtidAbAWOG_gKIFILQ0ovQPVDvR4qfIouGVsR7Jv11c7tbSyLN_qlAfFfLaCCewqHJ9THREKRt_A9VCbEKQdWJ7xKhHk Apr 17 10:43:08 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:43:08 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:43:08 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:43:08 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:43:08 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:43:08 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:43:08 user devstack@n-api.service[72743]: X-Project-Id: df0c657dc95549a3a3ce94f35bfa91be Apr 17 10:43:08 user devstack@n-api.service[72743]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1852888110 Apr 17 10:43:08 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:43:08 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:43:08 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df0c657dc95549a3a3ce94f35bfa91be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df0c657dc95549a3a3ce94f35bfa91be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/df0c657dc95549a3a3ce94f35bfa91be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:43:08 user devstack@n-api.service[72743]: X-Tenant: tempest-SnapshotDataIntegrityTests-1852888110 Apr 17 10:43:08 user devstack@n-api.service[72743]: X-Tenant-Id: df0c657dc95549a3a3ce94f35bfa91be Apr 17 10:43:08 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1852888110 Apr 17 10:43:08 user devstack@n-api.service[72743]: X-User: tempest-SnapshotDataIntegrityTests-1852888110-project-member Apr 17 10:43:08 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:43:08 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:43:08 user devstack@n-api.service[72743]: X-User-Id: ea177954e75a45f7ad7c9831ab55375a Apr 17 10:43:08 user devstack@n-api.service[72743]: X-User-Name: tempest-SnapshotDataIntegrityTests-1852888110-project-member Apr 17 10:43:08 user devstack@n-api.service[72743]: method: > Apr 17 10:43:08 user devstack@n-api.service[72743]: exception: Instance 7792cf72-dc73-4201-9501-4515ce860735 could not be found. Apr 17 10:43:08 user devstack@n-api.service[72743]: action_args: {'id': '7792cf72-dc73-4201-9501-4515ce860735'} Apr 17 10:43:08 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7792cf72-dc73-4201-9501-4515ce860735 could not be found. Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7792cf72-dc73-4201-9501-4515ce860735 could not be found. Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7792cf72-dc73-4201-9501-4515ce860735 could not be found. Apr 17 10:43:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:43:08 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-e94e852c-1ace-49ea-95b8-8bebf66b7ea6 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Returning 404 to user: Instance 7792cf72-dc73-4201-9501-4515ce860735 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:43:08 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-e94e852c-1ace-49ea-95b8-8bebf66b7ea6 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735" status: 404 len: 111 microversion: 2.1 time: 0.037189 Apr 17 10:43:08 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 162/480] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:43:08 2023] GET /compute/v2.1/servers/7792cf72-dc73-4201-9501-4515ce860735 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:43:08 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=8 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:43:08 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:43:08 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-04c3e01a-cd56-4876-a5e8-9a7d0be70031 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] Calling method '.version_select at 0x7fc55a82d510>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:43:08 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-04c3e01a-cd56-4876-a5e8-9a7d0be70031 tempest-SnapshotDataIntegrityTests-1852888110 tempest-SnapshotDataIntegrityTests-1852888110-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-645097723" status: 202 len: 0 microversion: 2.1 time: 0.032520 Apr 17 10:43:08 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 152/481] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 17 10:43:08 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-645097723 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:43:16 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-b29dbf05-c3e7-4535-9706-128d1a00cb57 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:43:16 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-b29dbf05-c3e7-4535-9706-128d1a00cb57 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:43:16 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b29dbf05-c3e7-4535-9706-128d1a00cb57 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:16 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b29dbf05-c3e7-4535-9706-128d1a00cb57 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:16 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b29dbf05-c3e7-4535-9706-128d1a00cb57 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:16 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b29dbf05-c3e7-4535-9706-128d1a00cb57 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:16 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b29dbf05-c3e7-4535-9706-128d1a00cb57 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:16 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b29dbf05-c3e7-4535-9706-128d1a00cb57 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:17 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-b29dbf05-c3e7-4535-9706-128d1a00cb57 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae91492cb6f342f58e250622e2a3ac11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b309bb2b37284020b81369ec89397374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:43:17 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-b29dbf05-c3e7-4535-9706-128d1a00cb57 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3e07a35c-b5cc-46df-8e83-21664fb83896" status: 200 len: 1487 microversion: 2.1 time: 0.253920 Apr 17 10:43:17 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 168/482] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:43:16 2023] GET /compute/v2.1/servers/3e07a35c-b5cc-46df-8e83-21664fb83896 => generated 1487 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:43:19 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-96c91323-3dca-4b92-93f6-6b2b3c074270 tempest-VolumesAdminNegativeTest-1956742641 tempest-VolumesAdminNegativeTest-1956742641-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "5cd2740a-4a42-49db-9d7a-4f301795b6a5"}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:43:19 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-96c91323-3dca-4b92-93f6-6b2b3c074270 tempest-VolumesAdminNegativeTest-1956742641 tempest-VolumesAdminNegativeTest-1956742641-project-admin] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:43:19 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:43:19 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:43:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-96c91323-3dca-4b92-93f6-6b2b3c074270 tempest-VolumesAdminNegativeTest-1956742641 tempest-VolumesAdminNegativeTest-1956742641-project-admin] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-96c91323-3dca-4b92-93f6-6b2b3c074270 tempest-VolumesAdminNegativeTest-1956742641 tempest-VolumesAdminNegativeTest-1956742641-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-96c91323-3dca-4b92-93f6-6b2b3c074270 tempest-VolumesAdminNegativeTest-1956742641 tempest-VolumesAdminNegativeTest-1956742641-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-96c91323-3dca-4b92-93f6-6b2b3c074270 tempest-VolumesAdminNegativeTest-1956742641 tempest-VolumesAdminNegativeTest-1956742641-project-admin] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-96c91323-3dca-4b92-93f6-6b2b3c074270 tempest-VolumesAdminNegativeTest-1956742641 tempest-VolumesAdminNegativeTest-1956742641-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-96c91323-3dca-4b92-93f6-6b2b3c074270 tempest-VolumesAdminNegativeTest-1956742641 tempest-VolumesAdminNegativeTest-1956742641-project-admin] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:19 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-96c91323-3dca-4b92-93f6-6b2b3c074270 tempest-VolumesAdminNegativeTest-1956742641 tempest-VolumesAdminNegativeTest-1956742641-project-admin] HTTP exception thrown: Volume bdf78e0f-89a5-4cf4-bf35-855c80b7c459 could not be found. Apr 17 10:43:19 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-96c91323-3dca-4b92-93f6-6b2b3c074270 tempest-VolumesAdminNegativeTest-1956742641 tempest-VolumesAdminNegativeTest-1956742641-project-admin] Request method failure captured: Apr 17 10:43:19 user devstack@n-api.service[72743]: request: PUT /compute/v2.1/servers/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4/os-volume_attachments/bdf78e0f-89a5-4cf4-bf35-855c80b7c459 HTTP/1.1 Apr 17 10:43:19 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:43:19 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:43:19 user devstack@n-api.service[72743]: Connection: close Apr 17 10:43:19 user devstack@n-api.service[72743]: Content-Length: 74 Apr 17 10:43:19 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:43:19 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:43:19 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:43:19 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:43:19 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSGjK1da_q820A0dVea_WrdtKkLMGLlpKZCLYOuwHXJepeNMW6jiGNP7jqOtVjOhKlSWOqUG91pcVkCvR1Y5ywNN7mUD2MJNAKWVcrx6BCk0-qg0eUdnO_2uhAovoCBKzcqAIqXE3C3KVpb7rGd2OBfdHwA5Cn0RLN9p8U9g9Sjuc7Y Apr 17 10:43:19 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:43:19 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:43:19 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:43:19 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:43:19 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:43:19 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:43:19 user devstack@n-api.service[72743]: X-Project-Id: 1cf7cd3e11504951a109190df64d30f9 Apr 17 10:43:19 user devstack@n-api.service[72743]: X-Project-Name: tempest-VolumesAdminNegativeTest-1956742641 Apr 17 10:43:19 user devstack@n-api.service[72743]: X-Role: admin,reader,member Apr 17 10:43:19 user devstack@n-api.service[72743]: X-Roles: admin,reader,member Apr 17 10:43:19 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1cf7cd3e11504951a109190df64d30f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1cf7cd3e11504951a109190df64d30f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1cf7cd3e11504951a109190df64d30f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:43:19 user devstack@n-api.service[72743]: X-Tenant: tempest-VolumesAdminNegativeTest-1956742641 Apr 17 10:43:19 user devstack@n-api.service[72743]: X-Tenant-Id: 1cf7cd3e11504951a109190df64d30f9 Apr 17 10:43:19 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1956742641 Apr 17 10:43:19 user devstack@n-api.service[72743]: X-User: tempest-VolumesAdminNegativeTest-1956742641-project-admin Apr 17 10:43:19 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:43:19 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:43:19 user devstack@n-api.service[72743]: X-User-Id: 6189d8f7847940e3835b1d5de52622e7 Apr 17 10:43:19 user devstack@n-api.service[72743]: X-User-Name: tempest-VolumesAdminNegativeTest-1956742641-project-admin Apr 17 10:43:19 user devstack@n-api.service[72743]: Apr 17 10:43:19 user devstack@n-api.service[72743]: {"volumeAttachment": {"volumeId": "5cd2740a-4a42-49db-9d7a-4f301795b6a5"}} Apr 17 10:43:19 user devstack@n-api.service[72743]: method: > Apr 17 10:43:19 user devstack@n-api.service[72743]: exception: Volume bdf78e0f-89a5-4cf4-bf35-855c80b7c459 could not be found. Apr 17 10:43:19 user devstack@n-api.service[72743]: action_args: {'server_id': '57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4', 'id': 'bdf78e0f-89a5-4cf4-bf35-855c80b7c459', 'body': {'volumeAttachment': {'volumeId': '5cd2740a-4a42-49db-9d7a-4f301795b6a5'}}} Apr 17 10:43:19 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bdf78e0f-89a5-4cf4-bf35-855c80b7c459 could not be found. (HTTP 404) (Request-ID: req-097dcfed-3989-409e-a027-449f700cc367) Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bdf78e0f-89a5-4cf4-bf35-855c80b7c459 could not be found. Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bdf78e0f-89a5-4cf4-bf35-855c80b7c459 could not be found. Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bdf78e0f-89a5-4cf4-bf35-855c80b7c459 could not be found. Apr 17 10:43:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:43:19 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-96c91323-3dca-4b92-93f6-6b2b3c074270 tempest-VolumesAdminNegativeTest-1956742641 tempest-VolumesAdminNegativeTest-1956742641-project-admin] Returning 404 to user: Volume bdf78e0f-89a5-4cf4-bf35-855c80b7c459 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:43:19 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-96c91323-3dca-4b92-93f6-6b2b3c074270 tempest-VolumesAdminNegativeTest-1956742641 tempest-VolumesAdminNegativeTest-1956742641-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4/os-volume_attachments/bdf78e0f-89a5-4cf4-bf35-855c80b7c459" status: 404 len: 109 microversion: 2.1 time: 0.268905 Apr 17 10:43:19 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 163/483] 10.0.0.210 () {64 vars in 1510 bytes} [Mon Apr 17 10:43:19 2023] PUT /compute/v2.1/servers/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4/os-volume_attachments/bdf78e0f-89a5-4cf4-bf35-855c80b7c459 => generated 109 bytes in 271 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:43:22 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:43:22 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:43:22 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:43:22 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:22 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:22 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:22 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:22 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:22 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:22 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Going to try to terminate instance {{(pid=72744) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:43:22 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-4d6f3b17-a337-46d4-8d9a-362cc7b6b38c tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4" status: 204 len: 0 microversion: 2.1 time: 0.126273 Apr 17 10:43:22 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 153/484] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:43:22 2023] DELETE /compute/v2.1/servers/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:43:22 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-f4106073-01fb-439e-858f-abd399302ed5 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:43:22 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-f4106073-01fb-439e-858f-abd399302ed5 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:43:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f4106073-01fb-439e-858f-abd399302ed5 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f4106073-01fb-439e-858f-abd399302ed5 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f4106073-01fb-439e-858f-abd399302ed5 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f4106073-01fb-439e-858f-abd399302ed5 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f4106073-01fb-439e-858f-abd399302ed5 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f4106073-01fb-439e-858f-abd399302ed5 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:23 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-a2f46f5b-ddfa-4fd8-b417-51a272b4caf2 req-dd1aad57-a798-4b2b-be65-1172f5e70025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4", "name": "network-vif-unplugged", "status": "completed", "tag": "bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:43:23 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-f4106073-01fb-439e-858f-abd399302ed5 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69d4d16a4bc479ba2a8a80f359135f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33eedb851ee244768016f5bf203d2f9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:43:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-a2f46f5b-ddfa-4fd8-b417-51a272b4caf2 req-dd1aad57-a798-4b2b-be65-1172f5e70025 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-a2f46f5b-ddfa-4fd8-b417-51a272b4caf2 req-dd1aad57-a798-4b2b-be65-1172f5e70025 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-a2f46f5b-ddfa-4fd8-b417-51a272b4caf2 req-dd1aad57-a798-4b2b-be65-1172f5e70025 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:23 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-f4106073-01fb-439e-858f-abd399302ed5 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4" status: 200 len: 1502 microversion: 2.1 time: 0.270574 Apr 17 10:43:23 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 169/485] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:43:22 2023] GET /compute/v2.1/servers/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4 => generated 1502 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:43:23 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-a2f46f5b-ddfa-4fd8-b417-51a272b4caf2 req-dd1aad57-a798-4b2b-be65-1172f5e70025 service nova] Creating event network-vif-unplugged:bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f for instance 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4 on user Apr 17 10:43:23 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-a2f46f5b-ddfa-4fd8-b417-51a272b4caf2 req-dd1aad57-a798-4b2b-be65-1172f5e70025 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053394 Apr 17 10:43:23 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 164/486] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:43:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:43:24 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-531d00e6-a58d-41f6-a919-2c1593232fd9 req-22faf3d1-f3f9-46ee-96b9-3d9179120216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4", "name": "network-vif-deleted", "tag": "bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:43:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-531d00e6-a58d-41f6-a919-2c1593232fd9 req-22faf3d1-f3f9-46ee-96b9-3d9179120216 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-531d00e6-a58d-41f6-a919-2c1593232fd9 req-22faf3d1-f3f9-46ee-96b9-3d9179120216 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-531d00e6-a58d-41f6-a919-2c1593232fd9 req-22faf3d1-f3f9-46ee-96b9-3d9179120216 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:24 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-531d00e6-a58d-41f6-a919-2c1593232fd9 req-22faf3d1-f3f9-46ee-96b9-3d9179120216 service nova] Creating event network-vif-deleted:bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f for instance 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4 on user Apr 17 10:43:24 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-531d00e6-a58d-41f6-a919-2c1593232fd9 req-22faf3d1-f3f9-46ee-96b9-3d9179120216 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037319 Apr 17 10:43:24 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 154/487] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:43:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:43:25 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-e52374a6-4509-48ad-b663-03fbd075ae49 req-c5aa6665-bba5-4961-8f2e-dbf03edccea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4", "name": "network-vif-plugged", "status": "completed", "tag": "bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:43:25 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-e52374a6-4509-48ad-b663-03fbd075ae49 req-c5aa6665-bba5-4961-8f2e-dbf03edccea9 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:25 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-e52374a6-4509-48ad-b663-03fbd075ae49 req-c5aa6665-bba5-4961-8f2e-dbf03edccea9 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:25 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-e52374a6-4509-48ad-b663-03fbd075ae49 req-c5aa6665-bba5-4961-8f2e-dbf03edccea9 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:25 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-e52374a6-4509-48ad-b663-03fbd075ae49 req-c5aa6665-bba5-4961-8f2e-dbf03edccea9 service nova] Creating event network-vif-plugged:bce56f65-9c97-4a6f-8f21-dee3b1e5ad0f for instance 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4 on user Apr 17 10:43:25 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-e52374a6-4509-48ad-b663-03fbd075ae49 req-c5aa6665-bba5-4961-8f2e-dbf03edccea9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030535 Apr 17 10:43:25 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 170/488] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:43:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:43:37 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=4 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:43:37 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:43:37 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-cb2d497f-409e-42de-ac07-4b94177ea6ed tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:43:37 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-cb2d497f-409e-42de-ac07-4b94177ea6ed tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:43:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-cb2d497f-409e-42de-ac07-4b94177ea6ed tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-cb2d497f-409e-42de-ac07-4b94177ea6ed tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-cb2d497f-409e-42de-ac07-4b94177ea6ed tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-cb2d497f-409e-42de-ac07-4b94177ea6ed tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-cb2d497f-409e-42de-ac07-4b94177ea6ed tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-cb2d497f-409e-42de-ac07-4b94177ea6ed tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:37 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-cb2d497f-409e-42de-ac07-4b94177ea6ed tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] HTTP exception thrown: Instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7 could not be found. Apr 17 10:43:37 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-cb2d497f-409e-42de-ac07-4b94177ea6ed tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Request method failure captured: Apr 17 10:43:37 user devstack@n-api.service[72743]: request: GET /compute/v2.1/servers/b0a9753b-207e-4c23-9fea-f7dc89a5edf7 HTTP/1.1 Apr 17 10:43:37 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:43:37 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:43:37 user devstack@n-api.service[72743]: Connection: close Apr 17 10:43:37 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:43:37 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:43:37 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:43:37 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:43:37 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:43:37 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSHHBSxJU3GfcgBo4oxop3Utq3Ux8-8rgyX-78CWsY7DpxBUrhJrx5DFmxVDOSS779NXyNEKXanmdpZXAZeKA-EO7YcmTrVyRLEcXoVn2i1Ne2ZaWSUvSM9rm-nfHcTK7GVYQQzRVOzwsgq1B2sVUsCajeEIUJ_VlPPhRLKnXmI48Yo Apr 17 10:43:37 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:43:37 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:43:37 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:43:37 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:43:37 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:43:37 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:43:37 user devstack@n-api.service[72743]: X-Project-Id: a8b831c3b6c244dda1821583a6b8cd08 Apr 17 10:43:37 user devstack@n-api.service[72743]: X-Project-Name: tempest-ServersNegativeTestJSON-812869679 Apr 17 10:43:37 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:43:37 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:43:37 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a8b831c3b6c244dda1821583a6b8cd08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a8b831c3b6c244dda1821583a6b8cd08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a8b831c3b6c244dda1821583a6b8cd08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:43:37 user devstack@n-api.service[72743]: X-Tenant: tempest-ServersNegativeTestJSON-812869679 Apr 17 10:43:37 user devstack@n-api.service[72743]: X-Tenant-Id: a8b831c3b6c244dda1821583a6b8cd08 Apr 17 10:43:37 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-ServersNegativeTestJSON-812869679 Apr 17 10:43:37 user devstack@n-api.service[72743]: X-User: tempest-ServersNegativeTestJSON-812869679-project-member Apr 17 10:43:37 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:43:37 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:43:37 user devstack@n-api.service[72743]: X-User-Id: 1e61a5e172c34636b183ef9c84b714d8 Apr 17 10:43:37 user devstack@n-api.service[72743]: X-User-Name: tempest-ServersNegativeTestJSON-812869679-project-member Apr 17 10:43:37 user devstack@n-api.service[72743]: method: > Apr 17 10:43:37 user devstack@n-api.service[72743]: exception: Instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7 could not be found. Apr 17 10:43:37 user devstack@n-api.service[72743]: action_args: {'id': 'b0a9753b-207e-4c23-9fea-f7dc89a5edf7'} Apr 17 10:43:37 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7 could not be found. Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7 could not be found. Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7 could not be found. Apr 17 10:43:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:43:37 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-cb2d497f-409e-42de-ac07-4b94177ea6ed tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Returning 404 to user: Instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:43:37 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-cb2d497f-409e-42de-ac07-4b94177ea6ed tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0a9753b-207e-4c23-9fea-f7dc89a5edf7" status: 404 len: 111 microversion: 2.1 time: 0.037012 Apr 17 10:43:37 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 165/489] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:43:37 2023] GET /compute/v2.1/servers/b0a9753b-207e-4c23-9fea-f7dc89a5edf7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:43:37 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:43:37 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:43:37 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-0365881a-da68-463e-b693-84894a033ae5 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:43:37 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-0365881a-da68-463e-b693-84894a033ae5 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:43:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-0365881a-da68-463e-b693-84894a033ae5 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-0365881a-da68-463e-b693-84894a033ae5 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-0365881a-da68-463e-b693-84894a033ae5 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-0365881a-da68-463e-b693-84894a033ae5 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-0365881a-da68-463e-b693-84894a033ae5 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-0365881a-da68-463e-b693-84894a033ae5 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:38 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-0365881a-da68-463e-b693-84894a033ae5 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e61a5e172c34636b183ef9c84b714d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b831c3b6c244dda1821583a6b8cd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:43:38 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-0365881a-da68-463e-b693-84894a033ae5 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e03807e-942b-4155-835b-b1c86f5b80f5" status: 200 len: 1494 microversion: 2.1 time: 0.233296 Apr 17 10:43:38 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 155/490] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:43:37 2023] GET /compute/v2.1/servers/5e03807e-942b-4155-835b-b1c86f5b80f5 => generated 1494 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:43:51 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=8 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:43:51 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=20 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:43:51 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-141369614", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "networks": [{"uuid": "5678ceef-3151-4d42-9106-9996eafd66f1"}]}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:43:51 user devstack@n-api.service[72745]: DEBUG nova.network.neutron [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] validate_networks() for [('5678ceef-3151-4d42-9106-9996eafd66f1', None, None, None, None, None)] {{(pid=72745) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:43:51 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Flavor limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:43:51 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Image limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:43:51 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Flavor pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:43:51 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Image pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:43:51 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:43:51 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:51 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:51 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:51 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:51 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:51 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:51 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Getting quotas for project faab4afa0ddf45578232627c2fac2ff8. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:43:51 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Getting quotas for user d8cb73d24d324903a625e4782270120e and project faab4afa0ddf45578232627c2fac2ff8. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:43:51 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Going to run 1 instances... {{(pid=72745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:43:51 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:43:51 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-6e5028b3-0407-49fe-a626-9948c7f2659f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.595172 Apr 17 10:43:51 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 171/491] 10.0.0.210 () {66 vars in 1265 bytes} [Mon Apr 17 10:43:51 2023] POST /compute/v2.1/servers => generated 378 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 17 10:43:51 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-c66c4ba7-ae18-4373-8e23-67dfbd7579ea tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:43:51 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-c66c4ba7-ae18-4373-8e23-67dfbd7579ea tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:43:51 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:43:51 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:43:52 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-c66c4ba7-ae18-4373-8e23-67dfbd7579ea tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:43:52 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-c66c4ba7-ae18-4373-8e23-67dfbd7579ea tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:43:52 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-c66c4ba7-ae18-4373-8e23-67dfbd7579ea tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:43:52 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-c66c4ba7-ae18-4373-8e23-67dfbd7579ea tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f" status: 200 len: 1394 microversion: 2.87 time: 0.087220 Apr 17 10:43:52 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 166/492] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:43:51 2023] GET /compute/v2.1/servers/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f => generated 1394 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:43:54 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-ab7910bc-4354-40f6-9974-4649aa4bd153 req-63477701-3730-419f-b757-16a90d2a68af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f", "tag": "141b2515-71aa-446f-9310-724be1ed6626"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:43:54 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:43:54 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:43:54 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-ab7910bc-4354-40f6-9974-4649aa4bd153 req-63477701-3730-419f-b757-16a90d2a68af service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:54 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-ab7910bc-4354-40f6-9974-4649aa4bd153 req-63477701-3730-419f-b757-16a90d2a68af service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:54 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-ab7910bc-4354-40f6-9974-4649aa4bd153 req-63477701-3730-419f-b757-16a90d2a68af service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:54 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-ab7910bc-4354-40f6-9974-4649aa4bd153 req-63477701-3730-419f-b757-16a90d2a68af service nova] Creating event network-changed:141b2515-71aa-446f-9310-724be1ed6626 for instance 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f on user Apr 17 10:43:54 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-ab7910bc-4354-40f6-9974-4649aa4bd153 req-63477701-3730-419f-b757-16a90d2a68af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036340 Apr 17 10:43:54 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 156/493] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:43:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:43:55 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-890a8051-2278-4804-b522-207a270ea4e4 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:43:55 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-890a8051-2278-4804-b522-207a270ea4e4 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:43:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-890a8051-2278-4804-b522-207a270ea4e4 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-890a8051-2278-4804-b522-207a270ea4e4 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-890a8051-2278-4804-b522-207a270ea4e4 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-890a8051-2278-4804-b522-207a270ea4e4 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-890a8051-2278-4804-b522-207a270ea4e4 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-890a8051-2278-4804-b522-207a270ea4e4 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:55 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-890a8051-2278-4804-b522-207a270ea4e4 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.180052 Apr 17 10:43:55 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 172/494] 10.0.0.210 () {64 vars in 1393 bytes} [Mon Apr 17 10:43:55 2023] GET /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b/os-interface => generated 282 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 10:43:55 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-ff55bab0-013e-4237-b1db-c9f11d54469d req-b3f33334-d992-4907-97c8-f26046c6d14d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "288bc9dc-1698-4ca9-a670-5e219c04202b", "tag": "8541d98c-fcb7-4f1a-904c-97db8145dd29"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:43:55 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-ff55bab0-013e-4237-b1db-c9f11d54469d req-b3f33334-d992-4907-97c8-f26046c6d14d service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:55 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-ff55bab0-013e-4237-b1db-c9f11d54469d req-b3f33334-d992-4907-97c8-f26046c6d14d service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:55 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-ff55bab0-013e-4237-b1db-c9f11d54469d req-b3f33334-d992-4907-97c8-f26046c6d14d service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:55 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-ff55bab0-013e-4237-b1db-c9f11d54469d req-b3f33334-d992-4907-97c8-f26046c6d14d service nova] Creating event network-changed:8541d98c-fcb7-4f1a-904c-97db8145dd29 for instance 288bc9dc-1698-4ca9-a670-5e219c04202b on user Apr 17 10:43:55 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-ff55bab0-013e-4237-b1db-c9f11d54469d req-b3f33334-d992-4907-97c8-f26046c6d14d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029695 Apr 17 10:43:55 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 167/495] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:43:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:43:55 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-18b1f26c-e289-431c-8764-aa25c9f900ca tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:43:55 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-18b1f26c-e289-431c-8764-aa25c9f900ca tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:43:55 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-18b1f26c-e289-431c-8764-aa25c9f900ca tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:55 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-18b1f26c-e289-431c-8764-aa25c9f900ca tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:55 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-18b1f26c-e289-431c-8764-aa25c9f900ca tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:55 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-18b1f26c-e289-431c-8764-aa25c9f900ca tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:55 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-18b1f26c-e289-431c-8764-aa25c9f900ca tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:55 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-18b1f26c-e289-431c-8764-aa25c9f900ca tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:56 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-18b1f26c-e289-431c-8764-aa25c9f900ca tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b/ips" status: 200 len: 109 microversion: 2.20 time: 0.037427 Apr 17 10:43:56 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 157/496] 10.0.0.210 () {64 vars in 1366 bytes} [Mon Apr 17 10:43:55 2023] GET /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b/ips => generated 109 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 10:43:56 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-8beaa60a-5191-43b9-a59c-1142df5fbeb0 req-fc135a2c-507f-4af4-9e7f-2f0e923bb9ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f", "name": "network-vif-plugged", "status": "completed", "tag": "141b2515-71aa-446f-9310-724be1ed6626"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:43:56 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-8beaa60a-5191-43b9-a59c-1142df5fbeb0 req-fc135a2c-507f-4af4-9e7f-2f0e923bb9ce service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:56 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-8beaa60a-5191-43b9-a59c-1142df5fbeb0 req-fc135a2c-507f-4af4-9e7f-2f0e923bb9ce service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:56 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-8beaa60a-5191-43b9-a59c-1142df5fbeb0 req-fc135a2c-507f-4af4-9e7f-2f0e923bb9ce service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:56 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-8beaa60a-5191-43b9-a59c-1142df5fbeb0 req-fc135a2c-507f-4af4-9e7f-2f0e923bb9ce service nova] Creating event network-vif-plugged:141b2515-71aa-446f-9310-724be1ed6626 for instance 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f on user Apr 17 10:43:56 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-8beaa60a-5191-43b9-a59c-1142df5fbeb0 req-fc135a2c-507f-4af4-9e7f-2f0e923bb9ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039735 Apr 17 10:43:56 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 173/497] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:43:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:43:58 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-1eb150f9-d546-4ca5-a7e0-f94798d427d2 req-cd296999-1372-4e15-8808-ae51caf91bfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f", "name": "network-vif-plugged", "status": "completed", "tag": "141b2515-71aa-446f-9310-724be1ed6626"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:43:58 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-1eb150f9-d546-4ca5-a7e0-f94798d427d2 req-cd296999-1372-4e15-8808-ae51caf91bfb service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:58 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-1eb150f9-d546-4ca5-a7e0-f94798d427d2 req-cd296999-1372-4e15-8808-ae51caf91bfb service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:58 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-1eb150f9-d546-4ca5-a7e0-f94798d427d2 req-cd296999-1372-4e15-8808-ae51caf91bfb service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:58 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-1eb150f9-d546-4ca5-a7e0-f94798d427d2 req-cd296999-1372-4e15-8808-ae51caf91bfb service nova] Creating event network-vif-plugged:141b2515-71aa-446f-9310-724be1ed6626 for instance 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f on user Apr 17 10:43:58 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-1eb150f9-d546-4ca5-a7e0-f94798d427d2 req-cd296999-1372-4e15-8808-ae51caf91bfb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037664 Apr 17 10:43:58 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 168/498] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:43:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:43:58 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:43:58 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:43:58 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:58 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:58 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:58 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:58 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:58 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:58 user devstack@n-api.service[72744]: DEBUG nova.objects.instance [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lazy-loading 'flavor' on Instance uuid 288bc9dc-1698-4ca9-a670-5e219c04202b {{(pid=72744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 10:43:59 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-70b44864-874f-4ca1-bdd0-c1993a722f21 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "POST /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b/action" status: 202 len: 0 microversion: 2.20 time: 1.027823 Apr 17 10:43:59 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 158/499] 10.0.0.210 () {66 vars in 1396 bytes} [Mon Apr 17 10:43:58 2023] POST /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b/action => generated 0 bytes in 1030 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:43:59 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-f3e47bb6-a97e-4f4e-9728-99a9b0508328 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:43:59 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-f3e47bb6-a97e-4f4e-9728-99a9b0508328 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:43:59 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f3e47bb6-a97e-4f4e-9728-99a9b0508328 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:59 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f3e47bb6-a97e-4f4e-9728-99a9b0508328 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:59 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f3e47bb6-a97e-4f4e-9728-99a9b0508328 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:59 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f3e47bb6-a97e-4f4e-9728-99a9b0508328 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:59 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f3e47bb6-a97e-4f4e-9728-99a9b0508328 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:59 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f3e47bb6-a97e-4f4e-9728-99a9b0508328 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:59 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-f3e47bb6-a97e-4f4e-9728-99a9b0508328 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:43:59 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-f3e47bb6-a97e-4f4e-9728-99a9b0508328 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:43:59 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-f3e47bb6-a97e-4f4e-9728-99a9b0508328 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:43:59 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-f3e47bb6-a97e-4f4e-9728-99a9b0508328 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b" status: 200 len: 1712 microversion: 2.20 time: 0.237203 Apr 17 10:43:59 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 174/500] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:43:59 2023] GET /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b => generated 1712 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:43:59 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-7a655d02-28e7-4ade-a021-c9c18cf1d699 req-4399603c-844e-4f3a-a0e8-1317f63a3fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "288bc9dc-1698-4ca9-a670-5e219c04202b", "name": "network-vif-unplugged", "status": "completed", "tag": "8541d98c-fcb7-4f1a-904c-97db8145dd29"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:43:59 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-7a655d02-28e7-4ade-a021-c9c18cf1d699 req-4399603c-844e-4f3a-a0e8-1317f63a3fb5 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:43:59 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-7a655d02-28e7-4ade-a021-c9c18cf1d699 req-4399603c-844e-4f3a-a0e8-1317f63a3fb5 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:43:59 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-7a655d02-28e7-4ade-a021-c9c18cf1d699 req-4399603c-844e-4f3a-a0e8-1317f63a3fb5 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:43:59 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-7a655d02-28e7-4ade-a021-c9c18cf1d699 req-4399603c-844e-4f3a-a0e8-1317f63a3fb5 service nova] Creating event network-vif-unplugged:8541d98c-fcb7-4f1a-904c-97db8145dd29 for instance 288bc9dc-1698-4ca9-a670-5e219c04202b on user Apr 17 10:43:59 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-7a655d02-28e7-4ade-a021-c9c18cf1d699 req-4399603c-844e-4f3a-a0e8-1317f63a3fb5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030556 Apr 17 10:43:59 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 169/501] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:43:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:44:02 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-e008165d-ce29-49a6-a6ee-b74e5cf47fd5 req-2d5e526b-5976-4619-95ed-18978d22ade9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "288bc9dc-1698-4ca9-a670-5e219c04202b", "name": "network-vif-plugged", "status": "completed", "tag": "8541d98c-fcb7-4f1a-904c-97db8145dd29"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:44:02 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-e008165d-ce29-49a6-a6ee-b74e5cf47fd5 req-2d5e526b-5976-4619-95ed-18978d22ade9 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:02 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-e008165d-ce29-49a6-a6ee-b74e5cf47fd5 req-2d5e526b-5976-4619-95ed-18978d22ade9 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:02 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-e008165d-ce29-49a6-a6ee-b74e5cf47fd5 req-2d5e526b-5976-4619-95ed-18978d22ade9 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:02 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-e008165d-ce29-49a6-a6ee-b74e5cf47fd5 req-2d5e526b-5976-4619-95ed-18978d22ade9 service nova] Creating event network-vif-plugged:8541d98c-fcb7-4f1a-904c-97db8145dd29 for instance 288bc9dc-1698-4ca9-a670-5e219c04202b on user Apr 17 10:44:02 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-e008165d-ce29-49a6-a6ee-b74e5cf47fd5 req-2d5e526b-5976-4619-95ed-18978d22ade9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032575 Apr 17 10:44:02 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 159/502] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:44:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:44:04 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-7b20d9bf-3b42-43ff-b3fe-d25fd559650f req-ce73a81e-9a7a-4c27-a39e-08dea25a41a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "288bc9dc-1698-4ca9-a670-5e219c04202b", "tag": "8541d98c-fcb7-4f1a-904c-97db8145dd29"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:44:04 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:44:04 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:44:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-7b20d9bf-3b42-43ff-b3fe-d25fd559650f req-ce73a81e-9a7a-4c27-a39e-08dea25a41a2 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-7b20d9bf-3b42-43ff-b3fe-d25fd559650f req-ce73a81e-9a7a-4c27-a39e-08dea25a41a2 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-7b20d9bf-3b42-43ff-b3fe-d25fd559650f req-ce73a81e-9a7a-4c27-a39e-08dea25a41a2 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:04 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-7b20d9bf-3b42-43ff-b3fe-d25fd559650f req-ce73a81e-9a7a-4c27-a39e-08dea25a41a2 service nova] Creating event network-changed:8541d98c-fcb7-4f1a-904c-97db8145dd29 for instance 288bc9dc-1698-4ca9-a670-5e219c04202b on user Apr 17 10:44:04 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-7b20d9bf-3b42-43ff-b3fe-d25fd559650f req-ce73a81e-9a7a-4c27-a39e-08dea25a41a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031823 Apr 17 10:44:04 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 175/503] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:44:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:44:08 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:44:08 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-6535b45b-886a-4675-9a98-771732f8b7c9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:44:08 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-6535b45b-886a-4675-9a98-771732f8b7c9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:44:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6535b45b-886a-4675-9a98-771732f8b7c9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6535b45b-886a-4675-9a98-771732f8b7c9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6535b45b-886a-4675-9a98-771732f8b7c9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6535b45b-886a-4675-9a98-771732f8b7c9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6535b45b-886a-4675-9a98-771732f8b7c9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6535b45b-886a-4675-9a98-771732f8b7c9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:08 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-6535b45b-886a-4675-9a98-771732f8b7c9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049184 Apr 17 10:44:08 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 170/504] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:44:08 2023] GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 17 10:44:08 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:44:08 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:44:08 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:08 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:08 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:08 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:08 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:08 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:08 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Going to try to terminate instance {{(pid=72744) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:44:08 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-6fc7616f-98cc-4aaa-b907-38459d13a608 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99" status: 204 len: 0 microversion: 2.1 time: 0.123356 Apr 17 10:44:08 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 160/505] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:44:08 2023] DELETE /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:44:08 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-331890fa-208b-4035-a379-7631f61af8a3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:44:08 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-331890fa-208b-4035-a379-7631f61af8a3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:44:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-331890fa-208b-4035-a379-7631f61af8a3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-331890fa-208b-4035-a379-7631f61af8a3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-331890fa-208b-4035-a379-7631f61af8a3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-331890fa-208b-4035-a379-7631f61af8a3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-331890fa-208b-4035-a379-7631f61af8a3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-331890fa-208b-4035-a379-7631f61af8a3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:08 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-b493cd2f-7afa-4172-85c8-7112428b4322 req-5f6cf2ad-76c8-4719-9023-eb9b96e0e867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59fd26de-d46e-4f41-91f6-090005a07d99", "name": "network-vif-unplugged", "status": "completed", "tag": "7124043d-665c-4a42-a041-b91ccc237b63"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:44:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-b493cd2f-7afa-4172-85c8-7112428b4322 req-5f6cf2ad-76c8-4719-9023-eb9b96e0e867 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-b493cd2f-7afa-4172-85c8-7112428b4322 req-5f6cf2ad-76c8-4719-9023-eb9b96e0e867 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-b493cd2f-7afa-4172-85c8-7112428b4322 req-5f6cf2ad-76c8-4719-9023-eb9b96e0e867 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:08 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-b493cd2f-7afa-4172-85c8-7112428b4322 req-5f6cf2ad-76c8-4719-9023-eb9b96e0e867 service nova] Creating event network-vif-unplugged:7124043d-665c-4a42-a041-b91ccc237b63 for instance 59fd26de-d46e-4f41-91f6-090005a07d99 on user Apr 17 10:44:08 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-b493cd2f-7afa-4172-85c8-7112428b4322 req-5f6cf2ad-76c8-4719-9023-eb9b96e0e867 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029753 Apr 17 10:44:08 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 171/506] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:44:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:44:08 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-331890fa-208b-4035-a379-7631f61af8a3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9862432f87f4500a46f32a0b27d54d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a17ec3e1b314acbb701f2d2d27d0560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:44:08 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-331890fa-208b-4035-a379-7631f61af8a3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99" status: 200 len: 1658 microversion: 2.1 time: 0.250460 Apr 17 10:44:08 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 176/507] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:44:08 2023] GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99 => generated 1658 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:44:10 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-e2249f92-14df-4821-af6b-7a1b24ccfe8f req-51ddc552-001e-4194-b1cf-fee1a49c2a64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59fd26de-d46e-4f41-91f6-090005a07d99", "name": "network-vif-plugged", "status": "completed", "tag": "7124043d-665c-4a42-a041-b91ccc237b63"}, {"server_uuid": "59fd26de-d46e-4f41-91f6-090005a07d99", "name": "network-vif-deleted", "tag": "7124043d-665c-4a42-a041-b91ccc237b63"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:44:10 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-e2249f92-14df-4821-af6b-7a1b24ccfe8f req-51ddc552-001e-4194-b1cf-fee1a49c2a64 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:10 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-e2249f92-14df-4821-af6b-7a1b24ccfe8f req-51ddc552-001e-4194-b1cf-fee1a49c2a64 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:10 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-e2249f92-14df-4821-af6b-7a1b24ccfe8f req-51ddc552-001e-4194-b1cf-fee1a49c2a64 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:10 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-e2249f92-14df-4821-af6b-7a1b24ccfe8f req-51ddc552-001e-4194-b1cf-fee1a49c2a64 service nova] Creating event network-vif-plugged:7124043d-665c-4a42-a041-b91ccc237b63 for instance 59fd26de-d46e-4f41-91f6-090005a07d99 on user Apr 17 10:44:10 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-e2249f92-14df-4821-af6b-7a1b24ccfe8f req-51ddc552-001e-4194-b1cf-fee1a49c2a64 service nova] Creating event network-vif-deleted:7124043d-665c-4a42-a041-b91ccc237b63 for instance 59fd26de-d46e-4f41-91f6-090005a07d99 on user Apr 17 10:44:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-e2249f92-14df-4821-af6b-7a1b24ccfe8f req-51ddc552-001e-4194-b1cf-fee1a49c2a64 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.065236 Apr 17 10:44:11 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 161/508] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:44:10 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:44:13 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-a0bd6106-2ebb-4725-a79c-b94b4d75726d tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:44:13 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-a0bd6106-2ebb-4725-a79c-b94b4d75726d tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:44:13 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a0bd6106-2ebb-4725-a79c-b94b4d75726d tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:13 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a0bd6106-2ebb-4725-a79c-b94b4d75726d tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:13 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a0bd6106-2ebb-4725-a79c-b94b4d75726d tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:13 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a0bd6106-2ebb-4725-a79c-b94b4d75726d tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:13 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a0bd6106-2ebb-4725-a79c-b94b4d75726d tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:13 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a0bd6106-2ebb-4725-a79c-b94b4d75726d tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:13 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-a0bd6106-2ebb-4725-a79c-b94b4d75726d tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] HTTP exception thrown: Instance 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4 could not be found. Apr 17 10:44:13 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-a0bd6106-2ebb-4725-a79c-b94b4d75726d tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Request method failure captured: Apr 17 10:44:13 user devstack@n-api.service[72743]: request: GET /compute/v2.1/servers/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4 HTTP/1.1 Apr 17 10:44:13 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:44:13 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:44:13 user devstack@n-api.service[72743]: Connection: close Apr 17 10:44:13 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:44:13 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:44:13 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:44:13 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:44:13 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:44:13 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSGZm9voS_1pYWPmEXVpsWL7_StKteWoJ0qMHg0H5143rW5NrROTCab04reE0Hzw4Mgiy5Cviwj9PYVf6L03eGfWad5hH-QFeeXTEcQAF0Jpq92-74yNHxBklQ05WvRMN8aoWUUEGxuCSNOq8EBNMLTcSnfL8pECyc_45RwTy3VO9ek Apr 17 10:44:13 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:44:13 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:44:13 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:44:13 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:44:13 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:44:13 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:44:13 user devstack@n-api.service[72743]: X-Project-Id: 33eedb851ee244768016f5bf203d2f9f Apr 17 10:44:13 user devstack@n-api.service[72743]: X-Project-Name: tempest-VolumesAdminNegativeTest-1835927457 Apr 17 10:44:13 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:44:13 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:44:13 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33eedb851ee244768016f5bf203d2f9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33eedb851ee244768016f5bf203d2f9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/33eedb851ee244768016f5bf203d2f9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:44:13 user devstack@n-api.service[72743]: X-Tenant: tempest-VolumesAdminNegativeTest-1835927457 Apr 17 10:44:13 user devstack@n-api.service[72743]: X-Tenant-Id: 33eedb851ee244768016f5bf203d2f9f Apr 17 10:44:13 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1835927457 Apr 17 10:44:13 user devstack@n-api.service[72743]: X-User: tempest-VolumesAdminNegativeTest-1835927457-project-member Apr 17 10:44:13 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:44:13 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:44:13 user devstack@n-api.service[72743]: X-User-Id: f69d4d16a4bc479ba2a8a80f359135f7 Apr 17 10:44:13 user devstack@n-api.service[72743]: X-User-Name: tempest-VolumesAdminNegativeTest-1835927457-project-member Apr 17 10:44:13 user devstack@n-api.service[72743]: method: > Apr 17 10:44:13 user devstack@n-api.service[72743]: exception: Instance 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4 could not be found. Apr 17 10:44:13 user devstack@n-api.service[72743]: action_args: {'id': '57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4'} Apr 17 10:44:13 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4 could not be found. Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4 could not be found. Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4 could not be found. Apr 17 10:44:13 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:44:13 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-a0bd6106-2ebb-4725-a79c-b94b4d75726d tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Returning 404 to user: Instance 57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:44:13 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-a0bd6106-2ebb-4725-a79c-b94b4d75726d tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4" status: 404 len: 111 microversion: 2.1 time: 0.204373 Apr 17 10:44:13 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 172/509] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:44:13 2023] GET /compute/v2.1/servers/57ee0b16-f265-47d5-ade8-1cc7f3dd5cf4 => generated 111 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:44:16 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:44:16 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:44:16 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:16 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:16 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:16 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:16 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:16 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:16 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Going to try to terminate instance {{(pid=72745) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:44:16 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-26685a25-14e1-484e-bdde-3b2746b888e0 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" status: 204 len: 0 microversion: 2.1 time: 0.123942 Apr 17 10:44:16 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 177/510] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:44:16 2023] DELETE /compute/v2.1/servers/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:44:16 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-d22006e6-2229-4aa6-b196-9c12bc26922f tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:44:16 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-d22006e6-2229-4aa6-b196-9c12bc26922f tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:44:16 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d22006e6-2229-4aa6-b196-9c12bc26922f tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:16 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d22006e6-2229-4aa6-b196-9c12bc26922f tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:16 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d22006e6-2229-4aa6-b196-9c12bc26922f tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:16 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d22006e6-2229-4aa6-b196-9c12bc26922f tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:16 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d22006e6-2229-4aa6-b196-9c12bc26922f tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:16 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d22006e6-2229-4aa6-b196-9c12bc26922f tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:16 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-d22006e6-2229-4aa6-b196-9c12bc26922f tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69d4d16a4bc479ba2a8a80f359135f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33eedb851ee244768016f5bf203d2f9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:44:17 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-d22006e6-2229-4aa6-b196-9c12bc26922f tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" status: 200 len: 1671 microversion: 2.1 time: 0.257317 Apr 17 10:44:17 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 162/511] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:44:16 2023] GET /compute/v2.1/servers/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf => generated 1671 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:44:17 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-cd807318-3cab-40ba-a902-470e3b95b204 req-2256964e-1ac1-4053-97e4-0917a4a4eec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf", "name": "network-vif-unplugged", "status": "completed", "tag": "e66863ce-1b10-4701-9a7c-3940117a0237"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:44:17 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-cd807318-3cab-40ba-a902-470e3b95b204 req-2256964e-1ac1-4053-97e4-0917a4a4eec0 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:17 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-cd807318-3cab-40ba-a902-470e3b95b204 req-2256964e-1ac1-4053-97e4-0917a4a4eec0 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:17 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-cd807318-3cab-40ba-a902-470e3b95b204 req-2256964e-1ac1-4053-97e4-0917a4a4eec0 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:17 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-cd807318-3cab-40ba-a902-470e3b95b204 req-2256964e-1ac1-4053-97e4-0917a4a4eec0 service nova] Creating event network-vif-unplugged:e66863ce-1b10-4701-9a7c-3940117a0237 for instance 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf on user Apr 17 10:44:17 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-cd807318-3cab-40ba-a902-470e3b95b204 req-2256964e-1ac1-4053-97e4-0917a4a4eec0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030511 Apr 17 10:44:17 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 173/512] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:44:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:44:17 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:44:17 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:44:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:17 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Going to try to terminate instance {{(pid=72745) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:44:17 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-c58b34b3-60f7-42e3-905d-f99320090b6e tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3e07a35c-b5cc-46df-8e83-21664fb83896" status: 204 len: 0 microversion: 2.1 time: 0.119484 Apr 17 10:44:17 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 178/513] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:44:17 2023] DELETE /compute/v2.1/servers/3e07a35c-b5cc-46df-8e83-21664fb83896 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:44:17 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-f6fd8c58-3b2d-454d-8e8b-b864dfae565c tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:44:17 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-f6fd8c58-3b2d-454d-8e8b-b864dfae565c tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:44:17 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f6fd8c58-3b2d-454d-8e8b-b864dfae565c tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:17 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f6fd8c58-3b2d-454d-8e8b-b864dfae565c tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:17 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f6fd8c58-3b2d-454d-8e8b-b864dfae565c tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:17 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f6fd8c58-3b2d-454d-8e8b-b864dfae565c tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:17 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f6fd8c58-3b2d-454d-8e8b-b864dfae565c tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:17 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f6fd8c58-3b2d-454d-8e8b-b864dfae565c tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:18 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-efff8d4c-7c5a-4c08-a5a6-5fb030d1c3e8 req-155aa3ff-94dd-4f65-a6fb-d2315b53c6a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e07a35c-b5cc-46df-8e83-21664fb83896", "name": "network-vif-unplugged", "status": "completed", "tag": "bc335a40-eaf8-46de-a9fe-8bcd2052b126"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:44:18 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-efff8d4c-7c5a-4c08-a5a6-5fb030d1c3e8 req-155aa3ff-94dd-4f65-a6fb-d2315b53c6a8 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:18 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-efff8d4c-7c5a-4c08-a5a6-5fb030d1c3e8 req-155aa3ff-94dd-4f65-a6fb-d2315b53c6a8 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:18 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-efff8d4c-7c5a-4c08-a5a6-5fb030d1c3e8 req-155aa3ff-94dd-4f65-a6fb-d2315b53c6a8 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:18 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-efff8d4c-7c5a-4c08-a5a6-5fb030d1c3e8 req-155aa3ff-94dd-4f65-a6fb-d2315b53c6a8 service nova] Creating event network-vif-unplugged:bc335a40-eaf8-46de-a9fe-8bcd2052b126 for instance 3e07a35c-b5cc-46df-8e83-21664fb83896 on user Apr 17 10:44:18 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-efff8d4c-7c5a-4c08-a5a6-5fb030d1c3e8 req-155aa3ff-94dd-4f65-a6fb-d2315b53c6a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031121 Apr 17 10:44:18 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 174/514] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:44:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:44:18 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-f6fd8c58-3b2d-454d-8e8b-b864dfae565c tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae91492cb6f342f58e250622e2a3ac11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b309bb2b37284020b81369ec89397374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:44:18 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-f6fd8c58-3b2d-454d-8e8b-b864dfae565c tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3e07a35c-b5cc-46df-8e83-21664fb83896" status: 200 len: 1493 microversion: 2.1 time: 0.949242 Apr 17 10:44:18 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 163/515] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:44:17 2023] GET /compute/v2.1/servers/3e07a35c-b5cc-46df-8e83-21664fb83896 => generated 1493 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:44:19 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-5efff160-d2fc-4ce8-8e62-f313c03cbcb1 req-f461b640-740e-43f0-8db1-9f3b0adbf658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf", "name": "network-vif-plugged", "status": "completed", "tag": "e66863ce-1b10-4701-9a7c-3940117a0237"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:44:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-5efff160-d2fc-4ce8-8e62-f313c03cbcb1 req-f461b640-740e-43f0-8db1-9f3b0adbf658 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-5efff160-d2fc-4ce8-8e62-f313c03cbcb1 req-f461b640-740e-43f0-8db1-9f3b0adbf658 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-5efff160-d2fc-4ce8-8e62-f313c03cbcb1 req-f461b640-740e-43f0-8db1-9f3b0adbf658 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:19 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-5efff160-d2fc-4ce8-8e62-f313c03cbcb1 req-f461b640-740e-43f0-8db1-9f3b0adbf658 service nova] Creating event network-vif-plugged:e66863ce-1b10-4701-9a7c-3940117a0237 for instance 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf on user Apr 17 10:44:19 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-5efff160-d2fc-4ce8-8e62-f313c03cbcb1 req-f461b640-740e-43f0-8db1-9f3b0adbf658 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029602 Apr 17 10:44:19 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 179/516] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:44:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:44:20 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-f8ec5ed8-00a9-4cb7-8a30-f75b4ee5ccb6 req-18a06d71-9077-46f4-88a9-9ac786d4b360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e07a35c-b5cc-46df-8e83-21664fb83896", "name": "network-vif-plugged", "status": "completed", "tag": "bc335a40-eaf8-46de-a9fe-8bcd2052b126"}, {"server_uuid": "89bbf0b5-0314-4bc5-ba97-feae5a5a49bf", "name": "network-vif-deleted", "tag": "e66863ce-1b10-4701-9a7c-3940117a0237"}, {"server_uuid": "3e07a35c-b5cc-46df-8e83-21664fb83896", "name": "network-vif-deleted", "tag": "bc335a40-eaf8-46de-a9fe-8bcd2052b126"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:44:20 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-f8ec5ed8-00a9-4cb7-8a30-f75b4ee5ccb6 req-18a06d71-9077-46f4-88a9-9ac786d4b360 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:20 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-f8ec5ed8-00a9-4cb7-8a30-f75b4ee5ccb6 req-18a06d71-9077-46f4-88a9-9ac786d4b360 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:20 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-f8ec5ed8-00a9-4cb7-8a30-f75b4ee5ccb6 req-18a06d71-9077-46f4-88a9-9ac786d4b360 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:20 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-f8ec5ed8-00a9-4cb7-8a30-f75b4ee5ccb6 req-18a06d71-9077-46f4-88a9-9ac786d4b360 service nova] Creating event network-vif-plugged:bc335a40-eaf8-46de-a9fe-8bcd2052b126 for instance 3e07a35c-b5cc-46df-8e83-21664fb83896 on user Apr 17 10:44:20 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-f8ec5ed8-00a9-4cb7-8a30-f75b4ee5ccb6 req-18a06d71-9077-46f4-88a9-9ac786d4b360 service nova] Creating event network-vif-deleted:e66863ce-1b10-4701-9a7c-3940117a0237 for instance 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf on user Apr 17 10:44:20 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-f8ec5ed8-00a9-4cb7-8a30-f75b4ee5ccb6 req-18a06d71-9077-46f4-88a9-9ac786d4b360 service nova] Creating event network-vif-deleted:bc335a40-eaf8-46de-a9fe-8bcd2052b126 for instance 3e07a35c-b5cc-46df-8e83-21664fb83896 on user Apr 17 10:44:20 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-f8ec5ed8-00a9-4cb7-8a30-f75b4ee5ccb6 req-18a06d71-9077-46f4-88a9-9ac786d4b360 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.038748 Apr 17 10:44:20 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 175/517] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:44:20 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:44:24 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-adbd04e4-f7fd-4272-8877-37c1b2e0a1e2 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Action: 'create', calling method: .version_select at 0x7fc55a82d480>, body: {"keypair": {"name": "tempest-TestStampPattern-12722321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuLQDJ2Z2AMQjPcpwBXxC60PoD0xwIae5XZ5z7x5L/fK+zl+/qEVvPMCnw86sAZZJR+5qNlBLSq4czZc4jysEkTXetR347vw/3aJ1wazOlhSEz/iMS3Zyr7Za5/g937hg=="}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:44:24 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:44:24 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-adbd04e4-f7fd-4272-8877-37c1b2e0a1e2 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Getting quotas for project 84cd384dfcbb4739b9694704c1fad001. Resources: {'key_pairs'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:44:24 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-adbd04e4-f7fd-4272-8877-37c1b2e0a1e2 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Getting quotas for user 708740584a3d488da0ee13e5f8299b7f and project 84cd384dfcbb4739b9694704c1fad001. Resources: {'key_pairs'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:44:24 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-adbd04e4-f7fd-4272-8877-37c1b2e0a1e2 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 393 microversion: 2.1 time: 0.259439 Apr 17 10:44:24 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 164/518] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 10:44:24 2023] POST /compute/v2.1/os-keypairs => generated 393 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:44:28 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1766110854", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "key_name": "tempest-TestStampPattern-12722321", "security_groups": [{"name": "tempest-secgroup-smoke-1808414415"}], "networks": [{"uuid": "01d90d12-f4b4-4119-ae59-f973d369d909"}]}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:44:28 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:44:28 user devstack@n-api.service[72745]: DEBUG nova.network.neutron [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] validate_networks() for [('01d90d12-f4b4-4119-ae59-f973d369d909', None, None, None, None, None)] {{(pid=72745) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:44:28 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Flavor limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:44:28 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Image limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:44:28 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Flavor pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:44:28 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Image pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:44:28 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:44:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:28 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:44:28 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Getting quotas for project 84cd384dfcbb4739b9694704c1fad001. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:44:28 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Getting quotas for user 708740584a3d488da0ee13e5f8299b7f and project 84cd384dfcbb4739b9694704c1fad001. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:44:29 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Going to run 1 instances... {{(pid=72745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:44:29 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:44:29 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-082c6f2b-0622-4244-a420-d53e41be8582 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.866282 Apr 17 10:44:29 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 180/519] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:44:28 2023] POST /compute/v2.1/servers => generated 404 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 10:44:29 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-c428afed-6202-4eee-944d-b114bd224178 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:44:29 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-c428afed-6202-4eee-944d-b114bd224178 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:44:29 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=25 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:44:29 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-c428afed-6202-4eee-944d-b114bd224178 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708740584a3d488da0ee13e5f8299b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84cd384dfcbb4739b9694704c1fad001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:44:29 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-c428afed-6202-4eee-944d-b114bd224178 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d61e9333-fe01-4a9e-abab-ef31ba6d4173" status: 200 len: 1235 microversion: 2.1 time: 0.248064 Apr 17 10:44:29 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 176/520] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:44:29 2023] GET /compute/v2.1/servers/d61e9333-fe01-4a9e-abab-ef31ba6d4173 => generated 1235 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:44:31 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:44:31 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-2da6e4ed-2749-4cc8-97a0-119926a40b8a req-ac9c137d-b69e-4db4-bf0a-b0b34934e252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d61e9333-fe01-4a9e-abab-ef31ba6d4173", "tag": "481e24d2-75a9-47c3-8d22-8573d260e7d3"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:44:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-2da6e4ed-2749-4cc8-97a0-119926a40b8a req-ac9c137d-b69e-4db4-bf0a-b0b34934e252 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-2da6e4ed-2749-4cc8-97a0-119926a40b8a req-ac9c137d-b69e-4db4-bf0a-b0b34934e252 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-2da6e4ed-2749-4cc8-97a0-119926a40b8a req-ac9c137d-b69e-4db4-bf0a-b0b34934e252 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:31 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-2da6e4ed-2749-4cc8-97a0-119926a40b8a req-ac9c137d-b69e-4db4-bf0a-b0b34934e252 service nova] Creating event network-changed:481e24d2-75a9-47c3-8d22-8573d260e7d3 for instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 on user Apr 17 10:44:31 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-2da6e4ed-2749-4cc8-97a0-119926a40b8a req-ac9c137d-b69e-4db4-bf0a-b0b34934e252 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041992 Apr 17 10:44:31 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 165/521] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:44:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:44:33 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-88c96142-9730-4e73-a0ca-5f27cbaab6af req-3f7b0571-af52-4aa0-99cd-01c6010074d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d61e9333-fe01-4a9e-abab-ef31ba6d4173", "name": "network-vif-plugged", "status": "completed", "tag": "481e24d2-75a9-47c3-8d22-8573d260e7d3"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:44:33 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-88c96142-9730-4e73-a0ca-5f27cbaab6af req-3f7b0571-af52-4aa0-99cd-01c6010074d4 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:33 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-88c96142-9730-4e73-a0ca-5f27cbaab6af req-3f7b0571-af52-4aa0-99cd-01c6010074d4 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:33 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-88c96142-9730-4e73-a0ca-5f27cbaab6af req-3f7b0571-af52-4aa0-99cd-01c6010074d4 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:33 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-88c96142-9730-4e73-a0ca-5f27cbaab6af req-3f7b0571-af52-4aa0-99cd-01c6010074d4 service nova] Creating event network-vif-plugged:481e24d2-75a9-47c3-8d22-8573d260e7d3 for instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 on user Apr 17 10:44:33 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-88c96142-9730-4e73-a0ca-5f27cbaab6af req-3f7b0571-af52-4aa0-99cd-01c6010074d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052505 Apr 17 10:44:33 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 181/522] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:44:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:44:35 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-d5f0276d-bf9c-4b81-8bf2-95dda7531479 req-035549ec-276f-46a2-9856-4111d19f138b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d61e9333-fe01-4a9e-abab-ef31ba6d4173", "name": "network-vif-plugged", "status": "completed", "tag": "481e24d2-75a9-47c3-8d22-8573d260e7d3"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:44:35 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=22 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:44:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-d5f0276d-bf9c-4b81-8bf2-95dda7531479 req-035549ec-276f-46a2-9856-4111d19f138b service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-d5f0276d-bf9c-4b81-8bf2-95dda7531479 req-035549ec-276f-46a2-9856-4111d19f138b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-d5f0276d-bf9c-4b81-8bf2-95dda7531479 req-035549ec-276f-46a2-9856-4111d19f138b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:35 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-d5f0276d-bf9c-4b81-8bf2-95dda7531479 req-035549ec-276f-46a2-9856-4111d19f138b service nova] Creating event network-vif-plugged:481e24d2-75a9-47c3-8d22-8573d260e7d3 for instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 on user Apr 17 10:44:35 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-d5f0276d-bf9c-4b81-8bf2-95dda7531479 req-035549ec-276f-46a2-9856-4111d19f138b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032774 Apr 17 10:44:35 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 177/523] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:44:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:44:40 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=4 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:44:40 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-8eb83e02-89d2-4224-b362-fff948a28c87 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1451737034", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "802603e4-f743-4ce2-a27b-fd94bdd3ea5f", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "d72c00d6-55cf-4a6c-9d41-f5bbe89865d8"}]}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:44:41 user devstack@n-api.service[72744]: INFO nova.api.openstack.wsgi [None req-8eb83e02-89d2-4224-b362-fff948a28c87 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] HTTP exception thrown: Block Device 802603e4-f743-4ce2-a27b-fd94bdd3ea5f is not bootable. Apr 17 10:44:41 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-8eb83e02-89d2-4224-b362-fff948a28c87 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Request method failure captured: Apr 17 10:44:41 user devstack@n-api.service[72744]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 17 10:44:41 user devstack@n-api.service[72744]: Accept: application/json Apr 17 10:44:41 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 10:44:41 user devstack@n-api.service[72744]: Connection: close Apr 17 10:44:41 user devstack@n-api.service[72744]: Content-Length: 357 Apr 17 10:44:41 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 10:44:41 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 10:44:41 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 10:44:41 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 10:44:41 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSHHBSxJU3GfcgBo4oxop3Utq3Ux8-8rgyX-78CWsY7DpxBUrhJrx5DFmxVDOSS779NXyNEKXanmdpZXAZeKA-EO7YcmTrVyRLEcXoVn2i1Ne2ZaWSUvSM9rm-nfHcTK7GVYQQzRVOzwsgq1B2sVUsCajeEIUJ_VlPPhRLKnXmI48Yo Apr 17 10:44:41 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 10:44:41 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 10:44:41 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 10:44:41 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 10:44:41 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 10:44:41 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 10:44:41 user devstack@n-api.service[72744]: X-Project-Id: a8b831c3b6c244dda1821583a6b8cd08 Apr 17 10:44:41 user devstack@n-api.service[72744]: X-Project-Name: tempest-ServersNegativeTestJSON-812869679 Apr 17 10:44:41 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 10:44:41 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 10:44:41 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a8b831c3b6c244dda1821583a6b8cd08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a8b831c3b6c244dda1821583a6b8cd08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a8b831c3b6c244dda1821583a6b8cd08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:44:41 user devstack@n-api.service[72744]: X-Tenant: tempest-ServersNegativeTestJSON-812869679 Apr 17 10:44:41 user devstack@n-api.service[72744]: X-Tenant-Id: a8b831c3b6c244dda1821583a6b8cd08 Apr 17 10:44:41 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-812869679 Apr 17 10:44:41 user devstack@n-api.service[72744]: X-User: tempest-ServersNegativeTestJSON-812869679-project-member Apr 17 10:44:41 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 10:44:41 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 10:44:41 user devstack@n-api.service[72744]: X-User-Id: 1e61a5e172c34636b183ef9c84b714d8 Apr 17 10:44:41 user devstack@n-api.service[72744]: X-User-Name: tempest-ServersNegativeTestJSON-812869679-project-member Apr 17 10:44:41 user devstack@n-api.service[72744]: Apr 17 10:44:41 user devstack@n-api.service[72744]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1451737034", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "802603e4-f743-4ce2-a27b-fd94bdd3ea5f", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "d72c00d6-55cf-4a6c-9d41-f5bbe89865d8"}]}} Apr 17 10:44:41 user devstack@n-api.service[72744]: method: > Apr 17 10:44:41 user devstack@n-api.service[72744]: exception: Block Device 802603e4-f743-4ce2-a27b-fd94bdd3ea5f is not bootable. Apr 17 10:44:41 user devstack@n-api.service[72744]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1451737034', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '802603e4-f743-4ce2-a27b-fd94bdd3ea5f'}], 'networks': [{'uuid': 'd72c00d6-55cf-4a6c-9d41-f5bbe89865d8'}]}}} Apr 17 10:44:41 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 802603e4-f743-4ce2-a27b-fd94bdd3ea5f is not bootable. Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 802603e4-f743-4ce2-a27b-fd94bdd3ea5f is not bootable. Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 802603e4-f743-4ce2-a27b-fd94bdd3ea5f is not bootable. Apr 17 10:44:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:44:41 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-8eb83e02-89d2-4224-b362-fff948a28c87 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Returning 400 to user: Block Device 802603e4-f743-4ce2-a27b-fd94bdd3ea5f is not bootable. {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:44:41 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-8eb83e02-89d2-4224-b362-fff948a28c87 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.127149 Apr 17 10:44:41 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 166/524] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:44:40 2023] POST /compute/v2.1/servers => generated 110 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 17 10:44:41 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-a482e349-e6b6-4917-8ee8-79b8f2258a78 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:44:41 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-a482e349-e6b6-4917-8ee8-79b8f2258a78 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:44:41 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:44:41 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:44:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a482e349-e6b6-4917-8ee8-79b8f2258a78 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a482e349-e6b6-4917-8ee8-79b8f2258a78 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a482e349-e6b6-4917-8ee8-79b8f2258a78 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a482e349-e6b6-4917-8ee8-79b8f2258a78 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a482e349-e6b6-4917-8ee8-79b8f2258a78 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a482e349-e6b6-4917-8ee8-79b8f2258a78 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:41 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-a482e349-e6b6-4917-8ee8-79b8f2258a78 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e61a5e172c34636b183ef9c84b714d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b831c3b6c244dda1821583a6b8cd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:44:41 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-a482e349-e6b6-4917-8ee8-79b8f2258a78 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e03807e-942b-4155-835b-b1c86f5b80f5" status: 200 len: 1494 microversion: 2.1 time: 0.231986 Apr 17 10:44:41 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 182/525] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:44:41 2023] GET /compute/v2.1/servers/5e03807e-942b-4155-835b-b1c86f5b80f5 => generated 1494 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:44:42 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:44:42 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b013d4c1-51a2-4f0f-bb0a-d1b71e396867 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:44:42 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-b013d4c1-51a2-4f0f-bb0a-d1b71e396867 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:44:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b013d4c1-51a2-4f0f-bb0a-d1b71e396867 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b013d4c1-51a2-4f0f-bb0a-d1b71e396867 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b013d4c1-51a2-4f0f-bb0a-d1b71e396867 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b013d4c1-51a2-4f0f-bb0a-d1b71e396867 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b013d4c1-51a2-4f0f-bb0a-d1b71e396867 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b013d4c1-51a2-4f0f-bb0a-d1b71e396867 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:42 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-b013d4c1-51a2-4f0f-bb0a-d1b71e396867 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:44:42 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-b013d4c1-51a2-4f0f-bb0a-d1b71e396867 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:44:42 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-b013d4c1-51a2-4f0f-bb0a-d1b71e396867 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:44:42 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-b013d4c1-51a2-4f0f-bb0a-d1b71e396867 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f" status: 200 len: 1691 microversion: 2.87 time: 0.333416 Apr 17 10:44:42 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 178/526] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:44:42 2023] GET /compute/v2.1/servers/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f => generated 1691 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:44:49 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:44:49 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-cf5909a9-4948-4060-aed1-243849b4f15c tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:44:49 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-cf5909a9-4948-4060-aed1-243849b4f15c tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:44:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cf5909a9-4948-4060-aed1-243849b4f15c tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cf5909a9-4948-4060-aed1-243849b4f15c tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cf5909a9-4948-4060-aed1-243849b4f15c tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cf5909a9-4948-4060-aed1-243849b4f15c tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cf5909a9-4948-4060-aed1-243849b4f15c tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cf5909a9-4948-4060-aed1-243849b4f15c tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:50 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-cf5909a9-4948-4060-aed1-243849b4f15c tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:44:50 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-cf5909a9-4948-4060-aed1-243849b4f15c tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:44:50 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-cf5909a9-4948-4060-aed1-243849b4f15c tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:44:50 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-cf5909a9-4948-4060-aed1-243849b4f15c tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b" status: 200 len: 1653 microversion: 2.20 time: 0.233830 Apr 17 10:44:50 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 167/527] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:44:49 2023] GET /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b => generated 1653 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:44:58 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-a2ce01de-d1ed-4d38-83f9-65d68b7f53f0 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:44:58 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-a2ce01de-d1ed-4d38-83f9-65d68b7f53f0 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:44:58 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=3 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:44:58 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=9 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:44:58 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a2ce01de-d1ed-4d38-83f9-65d68b7f53f0 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:58 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a2ce01de-d1ed-4d38-83f9-65d68b7f53f0 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:58 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a2ce01de-d1ed-4d38-83f9-65d68b7f53f0 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:58 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a2ce01de-d1ed-4d38-83f9-65d68b7f53f0 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:44:58 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a2ce01de-d1ed-4d38-83f9-65d68b7f53f0 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:44:58 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a2ce01de-d1ed-4d38-83f9-65d68b7f53f0 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:44:58 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-a2ce01de-d1ed-4d38-83f9-65d68b7f53f0 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] HTTP exception thrown: Instance 59fd26de-d46e-4f41-91f6-090005a07d99 could not be found. Apr 17 10:44:58 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-a2ce01de-d1ed-4d38-83f9-65d68b7f53f0 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Request method failure captured: Apr 17 10:44:58 user devstack@n-api.service[72745]: request: GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99 HTTP/1.1 Apr 17 10:44:58 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:44:58 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:44:58 user devstack@n-api.service[72745]: Connection: close Apr 17 10:44:58 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 10:44:58 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:44:58 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:44:58 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:44:58 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:44:58 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSCx2mb0bnvW5f2FJF2zY_X_OlIm3UEDUrC5-WRcj212HlWfKNe_D1jZqhVBMyegk-7_jZ95qzICGeXGUe_o7C-yIFpFVR3Eks3B7sJZC95tfHDVwBr_gefHHa_4-d9PUEMfLmCptg0OsFGeKfV1Fos6DUIkOUTmnRBrYWKo1kq4h8o Apr 17 10:44:58 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:44:58 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:44:58 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:44:58 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:44:58 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:44:58 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:44:58 user devstack@n-api.service[72745]: X-Project-Id: 6a17ec3e1b314acbb701f2d2d27d0560 Apr 17 10:44:58 user devstack@n-api.service[72745]: X-Project-Name: tempest-AttachVolumeTestJSON-2096000567 Apr 17 10:44:58 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:44:58 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:44:58 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a17ec3e1b314acbb701f2d2d27d0560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a17ec3e1b314acbb701f2d2d27d0560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6a17ec3e1b314acbb701f2d2d27d0560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:44:58 user devstack@n-api.service[72745]: X-Tenant: tempest-AttachVolumeTestJSON-2096000567 Apr 17 10:44:58 user devstack@n-api.service[72745]: X-Tenant-Id: 6a17ec3e1b314acbb701f2d2d27d0560 Apr 17 10:44:58 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2096000567 Apr 17 10:44:58 user devstack@n-api.service[72745]: X-User: tempest-AttachVolumeTestJSON-2096000567-project-member Apr 17 10:44:58 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:44:58 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:44:58 user devstack@n-api.service[72745]: X-User-Id: a9862432f87f4500a46f32a0b27d54d4 Apr 17 10:44:58 user devstack@n-api.service[72745]: X-User-Name: tempest-AttachVolumeTestJSON-2096000567-project-member Apr 17 10:44:58 user devstack@n-api.service[72745]: method: > Apr 17 10:44:58 user devstack@n-api.service[72745]: exception: Instance 59fd26de-d46e-4f41-91f6-090005a07d99 could not be found. Apr 17 10:44:58 user devstack@n-api.service[72745]: action_args: {'id': '59fd26de-d46e-4f41-91f6-090005a07d99'} Apr 17 10:44:58 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59fd26de-d46e-4f41-91f6-090005a07d99 could not be found. Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59fd26de-d46e-4f41-91f6-090005a07d99 could not be found. Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59fd26de-d46e-4f41-91f6-090005a07d99 could not be found. Apr 17 10:44:58 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:44:58 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-a2ce01de-d1ed-4d38-83f9-65d68b7f53f0 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Returning 404 to user: Instance 59fd26de-d46e-4f41-91f6-090005a07d99 could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:44:58 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-a2ce01de-d1ed-4d38-83f9-65d68b7f53f0 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99" status: 404 len: 111 microversion: 2.1 time: 0.036110 Apr 17 10:44:58 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 183/528] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:44:58 2023] GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:44:58 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-0b94a98c-7a0a-4926-9c8c-4a5463a7707f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '.version_select at 0x7fc55a729510>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:44:59 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=8 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:44:59 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=9 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:44:59 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-0b94a98c-7a0a-4926-9c8c-4a5463a7707f tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1429660859" status: 202 len: 0 microversion: 2.1 time: 0.031446 Apr 17 10:44:59 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 179/529] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Apr 17 10:44:58 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1429660859 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:44:59 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-08f6dcc3-41a3-4851-8846-14b89a7263d4 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Action: 'create', calling method: .version_select at 0x7fc55a82ff40>, body: {"keypair": {"name": "tempest-keypair-126931336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2zQYbD7AeLgZmChqO+D6PkkPLUnwIfI8qHYFWa2oQb85VVSXg9rCtBd8+F+B7OSL/DhEpq2QZwWqNC6GQai65/T4R6/KjN1qcR2Nh9LeePxLKBQPRrXkccsLFsLvoclQ=="}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:44:59 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:44:59 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-08f6dcc3-41a3-4851-8846-14b89a7263d4 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Getting quotas for project 6a17ec3e1b314acbb701f2d2d27d0560. Resources: {'key_pairs'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:44:59 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-08f6dcc3-41a3-4851-8846-14b89a7263d4 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Getting quotas for user a9862432f87f4500a46f32a0b27d54d4 and project 6a17ec3e1b314acbb701f2d2d27d0560. Resources: {'key_pairs'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:44:59 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-08f6dcc3-41a3-4851-8846-14b89a7263d4 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047198 Apr 17 10:44:59 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 168/530] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 10:44:59 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:45:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1717620221", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "9950f007-dbcc-4b9f-911a-7bd6a67f2c61"}], "security_groups": [{"name": "tempest-securitygroup--1243462729"}], "key_name": "tempest-keypair-126931336", "user_data": "}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:45:01 user devstack@n-api.service[72745]: DEBUG nova.network.neutron [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] validate_networks() for [('9950f007-dbcc-4b9f-911a-7bd6a67f2c61', None, None, None, None, None)] {{(pid=72745) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:45:01 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Flavor limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:45:01 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Image limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:45:01 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Flavor pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:45:01 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Image pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:45:01 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:45:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:01 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Getting quotas for project 6a17ec3e1b314acbb701f2d2d27d0560. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:45:01 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Getting quotas for user a9862432f87f4500a46f32a0b27d54d4 and project 6a17ec3e1b314acbb701f2d2d27d0560. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:45:01 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Going to run 1 instances... {{(pid=72745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:45:01 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:45:01 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-dde34d75-d500-4a84-b99b-1118c6a5ed12 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.626608 Apr 17 10:45:01 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 184/531] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:45:01 2023] POST /compute/v2.1/servers => generated 400 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 17 10:45:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-f1f5211b-e711-4c83-9087-5663530f10e4 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:45:01 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-f1f5211b-e711-4c83-9087-5663530f10e4 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:45:01 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-f1f5211b-e711-4c83-9087-5663530f10e4 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9862432f87f4500a46f32a0b27d54d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a17ec3e1b314acbb701f2d2d27d0560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:45:01 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-f1f5211b-e711-4c83-9087-5663530f10e4 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3" status: 200 len: 1231 microversion: 2.1 time: 0.065595 Apr 17 10:45:01 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 180/532] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:45:01 2023] GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3 => generated 1231 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:45:04 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:45:04 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-0559ecb6-c33e-4652-936a-0f486a960ac5 req-2b068f60-7ab5-4240-a45e-1239700fae2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44e80daa-73f1-4b84-8cbc-3dd0ea159da3", "tag": "20b83dbf-57d7-4d67-b030-53b0d12f01e2"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:45:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-0559ecb6-c33e-4652-936a-0f486a960ac5 req-2b068f60-7ab5-4240-a45e-1239700fae2c service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-0559ecb6-c33e-4652-936a-0f486a960ac5 req-2b068f60-7ab5-4240-a45e-1239700fae2c service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-0559ecb6-c33e-4652-936a-0f486a960ac5 req-2b068f60-7ab5-4240-a45e-1239700fae2c service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:04 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-0559ecb6-c33e-4652-936a-0f486a960ac5 req-2b068f60-7ab5-4240-a45e-1239700fae2c service nova] Creating event network-changed:20b83dbf-57d7-4d67-b030-53b0d12f01e2 for instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 on user Apr 17 10:45:04 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-0559ecb6-c33e-4652-936a-0f486a960ac5 req-2b068f60-7ab5-4240-a45e-1239700fae2c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082385 Apr 17 10:45:04 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 169/533] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:45:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:45:06 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-46bcda74-05fb-43d7-824c-a2e8c51f7f5d req-988f5714-de74-47a4-b9a1-2fe2cb1c7ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44e80daa-73f1-4b84-8cbc-3dd0ea159da3", "name": "network-vif-plugged", "status": "completed", "tag": "20b83dbf-57d7-4d67-b030-53b0d12f01e2"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:45:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-46bcda74-05fb-43d7-824c-a2e8c51f7f5d req-988f5714-de74-47a4-b9a1-2fe2cb1c7ec3 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-46bcda74-05fb-43d7-824c-a2e8c51f7f5d req-988f5714-de74-47a4-b9a1-2fe2cb1c7ec3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-46bcda74-05fb-43d7-824c-a2e8c51f7f5d req-988f5714-de74-47a4-b9a1-2fe2cb1c7ec3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:06 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-46bcda74-05fb-43d7-824c-a2e8c51f7f5d req-988f5714-de74-47a4-b9a1-2fe2cb1c7ec3 service nova] Creating event network-vif-plugged:20b83dbf-57d7-4d67-b030-53b0d12f01e2 for instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 on user Apr 17 10:45:06 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-46bcda74-05fb-43d7-824c-a2e8c51f7f5d req-988f5714-de74-47a4-b9a1-2fe2cb1c7ec3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035859 Apr 17 10:45:06 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 185/534] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:45:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:45:07 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-70817caf-0905-4ade-a410-c2484abec08e tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:45:07 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-70817caf-0905-4ade-a410-c2484abec08e tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] [instance: 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:45:07 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-70817caf-0905-4ade-a410-c2484abec08e tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:07 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-70817caf-0905-4ade-a410-c2484abec08e tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:07 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-70817caf-0905-4ade-a410-c2484abec08e tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:07 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-70817caf-0905-4ade-a410-c2484abec08e tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:07 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-70817caf-0905-4ade-a410-c2484abec08e tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:07 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-70817caf-0905-4ade-a410-c2484abec08e tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:07 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-70817caf-0905-4ade-a410-c2484abec08e tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] HTTP exception thrown: Instance 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf could not be found. Apr 17 10:45:07 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-70817caf-0905-4ade-a410-c2484abec08e tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Request method failure captured: Apr 17 10:45:07 user devstack@n-api.service[72743]: request: GET /compute/v2.1/servers/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf HTTP/1.1 Apr 17 10:45:07 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:45:07 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:45:07 user devstack@n-api.service[72743]: Connection: close Apr 17 10:45:07 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:45:07 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:45:07 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:45:07 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:45:07 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:45:07 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSGZm9voS_1pYWPmEXVpsWL7_StKteWoJ0qMHg0H5143rW5NrROTCab04reE0Hzw4Mgiy5Cviwj9PYVf6L03eGfWad5hH-QFeeXTEcQAF0Jpq92-74yNHxBklQ05WvRMN8aoWUUEGxuCSNOq8EBNMLTcSnfL8pECyc_45RwTy3VO9ek Apr 17 10:45:07 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:45:07 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:45:07 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:45:07 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:45:07 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:45:07 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:45:07 user devstack@n-api.service[72743]: X-Project-Id: 33eedb851ee244768016f5bf203d2f9f Apr 17 10:45:07 user devstack@n-api.service[72743]: X-Project-Name: tempest-VolumesAdminNegativeTest-1835927457 Apr 17 10:45:07 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:45:07 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:45:07 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33eedb851ee244768016f5bf203d2f9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33eedb851ee244768016f5bf203d2f9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/33eedb851ee244768016f5bf203d2f9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:45:07 user devstack@n-api.service[72743]: X-Tenant: tempest-VolumesAdminNegativeTest-1835927457 Apr 17 10:45:07 user devstack@n-api.service[72743]: X-Tenant-Id: 33eedb851ee244768016f5bf203d2f9f Apr 17 10:45:07 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1835927457 Apr 17 10:45:07 user devstack@n-api.service[72743]: X-User: tempest-VolumesAdminNegativeTest-1835927457-project-member Apr 17 10:45:07 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:45:07 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:45:07 user devstack@n-api.service[72743]: X-User-Id: f69d4d16a4bc479ba2a8a80f359135f7 Apr 17 10:45:07 user devstack@n-api.service[72743]: X-User-Name: tempest-VolumesAdminNegativeTest-1835927457-project-member Apr 17 10:45:07 user devstack@n-api.service[72743]: method: > Apr 17 10:45:07 user devstack@n-api.service[72743]: exception: Instance 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf could not be found. Apr 17 10:45:07 user devstack@n-api.service[72743]: action_args: {'id': '89bbf0b5-0314-4bc5-ba97-feae5a5a49bf'} Apr 17 10:45:07 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf could not be found. Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf could not be found. Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf could not be found. Apr 17 10:45:07 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:45:07 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-70817caf-0905-4ade-a410-c2484abec08e tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Returning 404 to user: Instance 89bbf0b5-0314-4bc5-ba97-feae5a5a49bf could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:45:07 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-70817caf-0905-4ade-a410-c2484abec08e tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf" status: 404 len: 111 microversion: 2.1 time: 0.033469 Apr 17 10:45:07 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 181/535] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:45:07 2023] GET /compute/v2.1/servers/89bbf0b5-0314-4bc5-ba97-feae5a5a49bf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:45:07 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-060e65b9-2b3b-4325-8663-8b3190789f69 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] Calling method '.version_select at 0x7fc55a82e9e0>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:45:07 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-060e65b9-2b3b-4325-8663-8b3190789f69 tempest-VolumesAdminNegativeTest-1835927457 tempest-VolumesAdminNegativeTest-1835927457-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1894950384" status: 202 len: 0 microversion: 2.1 time: 0.023572 Apr 17 10:45:07 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 170/536] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Apr 17 10:45:07 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1894950384 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:45:08 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-b1e86fa1-cea6-4cae-98ed-23e047a87ee3 req-493955ba-15f6-4a98-a2e4-a965fcc9a366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44e80daa-73f1-4b84-8cbc-3dd0ea159da3", "name": "network-vif-plugged", "status": "completed", "tag": "20b83dbf-57d7-4d67-b030-53b0d12f01e2"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:45:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-b1e86fa1-cea6-4cae-98ed-23e047a87ee3 req-493955ba-15f6-4a98-a2e4-a965fcc9a366 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-b1e86fa1-cea6-4cae-98ed-23e047a87ee3 req-493955ba-15f6-4a98-a2e4-a965fcc9a366 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-b1e86fa1-cea6-4cae-98ed-23e047a87ee3 req-493955ba-15f6-4a98-a2e4-a965fcc9a366 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:08 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-b1e86fa1-cea6-4cae-98ed-23e047a87ee3 req-493955ba-15f6-4a98-a2e4-a965fcc9a366 service nova] Creating event network-vif-plugged:20b83dbf-57d7-4d67-b030-53b0d12f01e2 for instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 on user Apr 17 10:45:08 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-b1e86fa1-cea6-4cae-98ed-23e047a87ee3 req-493955ba-15f6-4a98-a2e4-a965fcc9a366 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031795 Apr 17 10:45:08 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 186/537] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:45:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:45:08 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-3576c8bc-86ef-4a03-9638-ad335792b13f tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:45:08 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-3576c8bc-86ef-4a03-9638-ad335792b13f tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 3e07a35c-b5cc-46df-8e83-21664fb83896] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:45:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3576c8bc-86ef-4a03-9638-ad335792b13f tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3576c8bc-86ef-4a03-9638-ad335792b13f tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3576c8bc-86ef-4a03-9638-ad335792b13f tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3576c8bc-86ef-4a03-9638-ad335792b13f tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3576c8bc-86ef-4a03-9638-ad335792b13f tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3576c8bc-86ef-4a03-9638-ad335792b13f tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:08 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-3576c8bc-86ef-4a03-9638-ad335792b13f tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] HTTP exception thrown: Instance 3e07a35c-b5cc-46df-8e83-21664fb83896 could not be found. Apr 17 10:45:08 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-3576c8bc-86ef-4a03-9638-ad335792b13f tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Request method failure captured: Apr 17 10:45:08 user devstack@n-api.service[72743]: request: GET /compute/v2.1/servers/3e07a35c-b5cc-46df-8e83-21664fb83896 HTTP/1.1 Apr 17 10:45:08 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:45:08 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:45:08 user devstack@n-api.service[72743]: Connection: close Apr 17 10:45:08 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:45:08 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:45:08 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:45:08 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:45:08 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:45:08 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSKPyBJf2OVUMetl_wBUJBRvMDeY7t3SW0GcWIqsXxiztyOFgP-Au2u2KTaXnXALkzhlFD-j5ghH7fdrjrRNS0LZzPgDTvutwUUDlyjY8SeeB2i5P-Qa3o_ZgjNRjxHn7QYw60EGbp79RFNw_tqaJpH4w1nqP9xoqKBiRsWVZMlCz5g Apr 17 10:45:08 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:45:08 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:45:08 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:45:08 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:45:08 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:45:08 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:45:08 user devstack@n-api.service[72743]: X-Project-Id: b309bb2b37284020b81369ec89397374 Apr 17 10:45:08 user devstack@n-api.service[72743]: X-Project-Name: tempest-VolumesActionsTest-505690119 Apr 17 10:45:08 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:45:08 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:45:08 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b309bb2b37284020b81369ec89397374"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b309bb2b37284020b81369ec89397374"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b309bb2b37284020b81369ec89397374"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:45:08 user devstack@n-api.service[72743]: X-Tenant: tempest-VolumesActionsTest-505690119 Apr 17 10:45:08 user devstack@n-api.service[72743]: X-Tenant-Id: b309bb2b37284020b81369ec89397374 Apr 17 10:45:08 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-VolumesActionsTest-505690119 Apr 17 10:45:08 user devstack@n-api.service[72743]: X-User: tempest-VolumesActionsTest-505690119-project-member Apr 17 10:45:08 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:45:08 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:45:08 user devstack@n-api.service[72743]: X-User-Id: ae91492cb6f342f58e250622e2a3ac11 Apr 17 10:45:08 user devstack@n-api.service[72743]: X-User-Name: tempest-VolumesActionsTest-505690119-project-member Apr 17 10:45:08 user devstack@n-api.service[72743]: method: > Apr 17 10:45:08 user devstack@n-api.service[72743]: exception: Instance 3e07a35c-b5cc-46df-8e83-21664fb83896 could not be found. Apr 17 10:45:08 user devstack@n-api.service[72743]: action_args: {'id': '3e07a35c-b5cc-46df-8e83-21664fb83896'} Apr 17 10:45:08 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e07a35c-b5cc-46df-8e83-21664fb83896 could not be found. Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e07a35c-b5cc-46df-8e83-21664fb83896 could not be found. Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e07a35c-b5cc-46df-8e83-21664fb83896 could not be found. Apr 17 10:45:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:45:08 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-3576c8bc-86ef-4a03-9638-ad335792b13f tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Returning 404 to user: Instance 3e07a35c-b5cc-46df-8e83-21664fb83896 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:45:08 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-3576c8bc-86ef-4a03-9638-ad335792b13f tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3e07a35c-b5cc-46df-8e83-21664fb83896" status: 404 len: 111 microversion: 2.1 time: 0.033245 Apr 17 10:45:08 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 182/538] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:45:08 2023] GET /compute/v2.1/servers/3e07a35c-b5cc-46df-8e83-21664fb83896 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:45:09 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1414837798", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "networks": [{"uuid": "a617c444-412d-4406-abf8-e1e2f697247e"}]}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:45:09 user devstack@n-api.service[72744]: DEBUG nova.network.neutron [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] validate_networks() for [('a617c444-412d-4406-abf8-e1e2f697247e', None, None, None, None, None)] {{(pid=72744) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:45:09 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Flavor limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:45:09 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Image limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:45:09 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Flavor pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:45:09 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Image pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:45:09 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:45:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:09 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Getting quotas for project b309bb2b37284020b81369ec89397374. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:45:09 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Getting quotas for user ae91492cb6f342f58e250622e2a3ac11 and project b309bb2b37284020b81369ec89397374. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:45:09 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Going to run 1 instances... {{(pid=72744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:45:09 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:45:09 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-b0fc0cf5-b806-44a2-87a5-6eb6dcde3aaf tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.757645 Apr 17 10:45:09 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 171/539] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:45:09 2023] POST /compute/v2.1/servers => generated 378 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 10:45:09 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-c773e091-5676-4f13-9f81-94d0f738fde5 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:45:09 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-c773e091-5676-4f13-9f81-94d0f738fde5 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:45:10 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-c773e091-5676-4f13-9f81-94d0f738fde5 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae91492cb6f342f58e250622e2a3ac11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b309bb2b37284020b81369ec89397374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:45:10 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-c773e091-5676-4f13-9f81-94d0f738fde5 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9174e76f-1f0e-431c-b190-cb857eead406" status: 200 len: 1208 microversion: 2.1 time: 0.172789 Apr 17 10:45:10 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 187/540] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:45:09 2023] GET /compute/v2.1/servers/9174e76f-1f0e-431c-b190-cb857eead406 => generated 1208 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 17 10:45:12 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-456558c4-d579-4b04-ac28-c8750d7141b1 req-890e020d-157e-49c5-89ed-e2974411c219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9174e76f-1f0e-431c-b190-cb857eead406", "tag": "d988d5c2-1a5a-425e-8dca-eee7b1783eae"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:45:12 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:45:12 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-456558c4-d579-4b04-ac28-c8750d7141b1 req-890e020d-157e-49c5-89ed-e2974411c219 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:12 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-456558c4-d579-4b04-ac28-c8750d7141b1 req-890e020d-157e-49c5-89ed-e2974411c219 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:12 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-456558c4-d579-4b04-ac28-c8750d7141b1 req-890e020d-157e-49c5-89ed-e2974411c219 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:12 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-456558c4-d579-4b04-ac28-c8750d7141b1 req-890e020d-157e-49c5-89ed-e2974411c219 service nova] Creating event network-changed:d988d5c2-1a5a-425e-8dca-eee7b1783eae for instance 9174e76f-1f0e-431c-b190-cb857eead406 on user Apr 17 10:45:12 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-456558c4-d579-4b04-ac28-c8750d7141b1 req-890e020d-157e-49c5-89ed-e2974411c219 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037834 Apr 17 10:45:12 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 183/541] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:45:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:45:14 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-aa26d757-2a04-460d-8404-addaa9bc80b7 req-bc151415-4eaa-4dd2-ada1-fc6f4075631f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9174e76f-1f0e-431c-b190-cb857eead406", "name": "network-vif-plugged", "status": "completed", "tag": "d988d5c2-1a5a-425e-8dca-eee7b1783eae"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:45:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-aa26d757-2a04-460d-8404-addaa9bc80b7 req-bc151415-4eaa-4dd2-ada1-fc6f4075631f service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-aa26d757-2a04-460d-8404-addaa9bc80b7 req-bc151415-4eaa-4dd2-ada1-fc6f4075631f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-aa26d757-2a04-460d-8404-addaa9bc80b7 req-bc151415-4eaa-4dd2-ada1-fc6f4075631f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:14 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-aa26d757-2a04-460d-8404-addaa9bc80b7 req-bc151415-4eaa-4dd2-ada1-fc6f4075631f service nova] Creating event network-vif-plugged:d988d5c2-1a5a-425e-8dca-eee7b1783eae for instance 9174e76f-1f0e-431c-b190-cb857eead406 on user Apr 17 10:45:14 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-aa26d757-2a04-460d-8404-addaa9bc80b7 req-bc151415-4eaa-4dd2-ada1-fc6f4075631f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097349 Apr 17 10:45:14 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 172/542] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:45:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:45:17 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-c8f8f648-d9a0-4a7e-a497-69a1f81cccb2 req-26bff117-4eca-443b-971d-a35edd1af10d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9174e76f-1f0e-431c-b190-cb857eead406", "name": "network-vif-plugged", "status": "completed", "tag": "d988d5c2-1a5a-425e-8dca-eee7b1783eae"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:45:17 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:45:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-c8f8f648-d9a0-4a7e-a497-69a1f81cccb2 req-26bff117-4eca-443b-971d-a35edd1af10d service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-c8f8f648-d9a0-4a7e-a497-69a1f81cccb2 req-26bff117-4eca-443b-971d-a35edd1af10d service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-c8f8f648-d9a0-4a7e-a497-69a1f81cccb2 req-26bff117-4eca-443b-971d-a35edd1af10d service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:17 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-c8f8f648-d9a0-4a7e-a497-69a1f81cccb2 req-26bff117-4eca-443b-971d-a35edd1af10d service nova] Creating event network-vif-plugged:d988d5c2-1a5a-425e-8dca-eee7b1783eae for instance 9174e76f-1f0e-431c-b190-cb857eead406 on user Apr 17 10:45:17 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-c8f8f648-d9a0-4a7e-a497-69a1f81cccb2 req-26bff117-4eca-443b-971d-a35edd1af10d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036751 Apr 17 10:45:17 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 188/543] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:45:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:45:19 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-d0f9a05f-d1fe-4493-b1a3-0280130f8ca6 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:45:19 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-d0f9a05f-d1fe-4493-b1a3-0280130f8ca6 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:45:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d0f9a05f-d1fe-4493-b1a3-0280130f8ca6 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d0f9a05f-d1fe-4493-b1a3-0280130f8ca6 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d0f9a05f-d1fe-4493-b1a3-0280130f8ca6 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d0f9a05f-d1fe-4493-b1a3-0280130f8ca6 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d0f9a05f-d1fe-4493-b1a3-0280130f8ca6 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d0f9a05f-d1fe-4493-b1a3-0280130f8ca6 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:19 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-d0f9a05f-d1fe-4493-b1a3-0280130f8ca6 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708740584a3d488da0ee13e5f8299b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84cd384dfcbb4739b9694704c1fad001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:45:19 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-d0f9a05f-d1fe-4493-b1a3-0280130f8ca6 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d61e9333-fe01-4a9e-abab-ef31ba6d4173" status: 200 len: 1536 microversion: 2.1 time: 0.279052 Apr 17 10:45:19 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 184/544] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:45:19 2023] GET /compute/v2.1/servers/d61e9333-fe01-4a9e-abab-ef31ba6d4173 => generated 1536 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:45:23 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:45:23 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=10 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:45:23 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-d5446684-da65-4b23-a2fd-422e7ba27d6f tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Action: 'create', calling method: .version_select at 0x7fc55a82f1c0>, body: {"keypair": {"name": "tempest-keypair-681910651", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe44UPgN2vMYzbf2yE/ecyiKAX7xhMryPGLcf7fuvJ32/g9X1xCio8uDm6gOKJWBkSef7FKQGg7bGW+ylYNg3qLYPUGdYkruvLk5JxwxeXjR5lpfjhpuC+MfCdCXklu+w=="}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:45:23 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-d5446684-da65-4b23-a2fd-422e7ba27d6f tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting quotas for project cc1b39ff9581474b87c58164e5cafa00. Resources: {'key_pairs'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:45:23 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-d5446684-da65-4b23-a2fd-422e7ba27d6f tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting quotas for user a7e218d771db49e88d13d3b088f3d88a and project cc1b39ff9581474b87c58164e5cafa00. Resources: {'key_pairs'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:45:23 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-d5446684-da65-4b23-a2fd-422e7ba27d6f tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.187537 Apr 17 10:45:23 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 173/545] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 10:45:23 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:45:25 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=8 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:45:25 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-972682008", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "b6f8ce20-6af1-47a1-8b12-a5be609289ec"}], "security_groups": [{"name": "tempest-securitygroup--653924103"}], "key_name": "tempest-keypair-681910651", "user_data": "}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:45:25 user devstack@n-api.service[72745]: DEBUG nova.network.neutron [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] validate_networks() for [('b6f8ce20-6af1-47a1-8b12-a5be609289ec', None, None, None, None, None)] {{(pid=72745) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:45:25 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flavor limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:45:25 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Image limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:45:25 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flavor pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:45:25 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Image pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:45:25 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:45:25 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:25 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:25 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:25 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:25 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:25 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:25 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting quotas for project cc1b39ff9581474b87c58164e5cafa00. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:45:25 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting quotas for user a7e218d771db49e88d13d3b088f3d88a and project cc1b39ff9581474b87c58164e5cafa00. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:45:25 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Going to run 1 instances... {{(pid=72745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:45:25 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:45:25 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-dcd21f98-dd5d-4bd0-838d-7709d0dab4dc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.620930 Apr 17 10:45:25 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 189/546] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:45:25 2023] POST /compute/v2.1/servers => generated 406 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 10:45:25 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-6fd00d76-7020-4cf6-a5ec-c5aaa3ac396d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:45:25 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-6fd00d76-7020-4cf6-a5ec-c5aaa3ac396d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:45:25 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-6fd00d76-7020-4cf6-a5ec-c5aaa3ac396d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:45:25 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-6fd00d76-7020-4cf6-a5ec-c5aaa3ac396d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 200 len: 1231 microversion: 2.1 time: 0.059440 Apr 17 10:45:25 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 185/547] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:45:25 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 1231 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:45:28 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:45:28 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-8d61d0e7-f405-4b54-9056-1618de0d4bb8 req-15429546-48fb-44a6-a369-59a46b2e48bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38", "tag": "67386c8f-911d-4398-b449-42af25f6afe3"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:45:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-8d61d0e7-f405-4b54-9056-1618de0d4bb8 req-15429546-48fb-44a6-a369-59a46b2e48bf service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-8d61d0e7-f405-4b54-9056-1618de0d4bb8 req-15429546-48fb-44a6-a369-59a46b2e48bf service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-8d61d0e7-f405-4b54-9056-1618de0d4bb8 req-15429546-48fb-44a6-a369-59a46b2e48bf service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:28 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-8d61d0e7-f405-4b54-9056-1618de0d4bb8 req-15429546-48fb-44a6-a369-59a46b2e48bf service nova] Creating event network-changed:67386c8f-911d-4398-b449-42af25f6afe3 for instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 on user Apr 17 10:45:28 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-8d61d0e7-f405-4b54-9056-1618de0d4bb8 req-15429546-48fb-44a6-a369-59a46b2e48bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033241 Apr 17 10:45:28 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 174/548] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:45:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:45:30 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-3dd485ac-1379-42f4-9176-4c48a9da4911 req-3496ac7f-001e-41f9-b6ce-eded7489e0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38", "name": "network-vif-plugged", "status": "completed", "tag": "67386c8f-911d-4398-b449-42af25f6afe3"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:45:30 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:45:30 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-3dd485ac-1379-42f4-9176-4c48a9da4911 req-3496ac7f-001e-41f9-b6ce-eded7489e0e6 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:30 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-3dd485ac-1379-42f4-9176-4c48a9da4911 req-3496ac7f-001e-41f9-b6ce-eded7489e0e6 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:30 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-3dd485ac-1379-42f4-9176-4c48a9da4911 req-3496ac7f-001e-41f9-b6ce-eded7489e0e6 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:30 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=13 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:45:30 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-3dd485ac-1379-42f4-9176-4c48a9da4911 req-3496ac7f-001e-41f9-b6ce-eded7489e0e6 service nova] Creating event network-vif-plugged:67386c8f-911d-4398-b449-42af25f6afe3 for instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 on user Apr 17 10:45:30 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-3dd485ac-1379-42f4-9176-4c48a9da4911 req-3496ac7f-001e-41f9-b6ce-eded7489e0e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040499 Apr 17 10:45:30 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 190/549] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:45:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:45:32 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-4c254fd7-1963-449e-b76a-c06fbf9f29ab req-03f54aca-8643-4b13-ac32-f2d50fd1a551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38", "name": "network-vif-plugged", "status": "completed", "tag": "67386c8f-911d-4398-b449-42af25f6afe3"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:45:32 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=12 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:45:32 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:45:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-4c254fd7-1963-449e-b76a-c06fbf9f29ab req-03f54aca-8643-4b13-ac32-f2d50fd1a551 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-4c254fd7-1963-449e-b76a-c06fbf9f29ab req-03f54aca-8643-4b13-ac32-f2d50fd1a551 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-4c254fd7-1963-449e-b76a-c06fbf9f29ab req-03f54aca-8643-4b13-ac32-f2d50fd1a551 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:32 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-4c254fd7-1963-449e-b76a-c06fbf9f29ab req-03f54aca-8643-4b13-ac32-f2d50fd1a551 service nova] Creating event network-vif-plugged:67386c8f-911d-4398-b449-42af25f6afe3 for instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 on user Apr 17 10:45:32 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-4c254fd7-1963-449e-b76a-c06fbf9f29ab req-03f54aca-8643-4b13-ac32-f2d50fd1a551 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036078 Apr 17 10:45:32 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 186/550] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:45:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 10:45:41 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=4 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:45:41 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:45:41 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:45:41 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-fe206095-705a-429d-aabb-4cd6a939100d tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:45:41 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-fe206095-705a-429d-aabb-4cd6a939100d tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:45:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-fe206095-705a-429d-aabb-4cd6a939100d tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-fe206095-705a-429d-aabb-4cd6a939100d tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-fe206095-705a-429d-aabb-4cd6a939100d tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-fe206095-705a-429d-aabb-4cd6a939100d tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-fe206095-705a-429d-aabb-4cd6a939100d tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-fe206095-705a-429d-aabb-4cd6a939100d tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:41 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-fe206095-705a-429d-aabb-4cd6a939100d tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e61a5e172c34636b183ef9c84b714d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b831c3b6c244dda1821583a6b8cd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:45:41 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-fe206095-705a-429d-aabb-4cd6a939100d tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e03807e-942b-4155-835b-b1c86f5b80f5" status: 200 len: 1494 microversion: 2.1 time: 0.215199 Apr 17 10:45:41 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 175/551] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:45:41 2023] GET /compute/v2.1/servers/5e03807e-942b-4155-835b-b1c86f5b80f5 => generated 1494 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:45:42 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:45:42 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:45:42 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:45:42 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-618814786"}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:45:42 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:45:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:43 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-121a0f3a-e905-468c-98e4-a1515099d66d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "POST /compute/v2.1/servers/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/action" status: 202 len: 52 microversion: 2.87 time: 0.912516 Apr 17 10:45:43 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 191/552] 10.0.0.210 () {66 vars in 1396 bytes} [Mon Apr 17 10:45:42 2023] POST /compute/v2.1/servers/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f/action => generated 52 bytes in 915 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 17 10:45:48 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:45:48 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:45:48 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:45:48 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-caa06541-8b8f-4138-9c5c-d0663f9214ff tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:45:48 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-caa06541-8b8f-4138-9c5c-d0663f9214ff tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:45:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-caa06541-8b8f-4138-9c5c-d0663f9214ff tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-caa06541-8b8f-4138-9c5c-d0663f9214ff tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-caa06541-8b8f-4138-9c5c-d0663f9214ff tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-caa06541-8b8f-4138-9c5c-d0663f9214ff tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-caa06541-8b8f-4138-9c5c-d0663f9214ff tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-caa06541-8b8f-4138-9c5c-d0663f9214ff tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:48 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-caa06541-8b8f-4138-9c5c-d0663f9214ff tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:45:48 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-caa06541-8b8f-4138-9c5c-d0663f9214ff tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:45:48 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-caa06541-8b8f-4138-9c5c-d0663f9214ff tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:45:48 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-caa06541-8b8f-4138-9c5c-d0663f9214ff tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f" status: 200 len: 1691 microversion: 2.87 time: 0.271993 Apr 17 10:45:48 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 187/553] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:45:48 2023] GET /compute/v2.1/servers/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f => generated 1691 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 17 10:45:50 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-92fa9bff-ade4-410a-b637-b2276d181816 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79f52f23-7af1-4f57-9976-222fc404e821"}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:45:50 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-92fa9bff-ade4-410a-b637-b2276d181816 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:45:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-92fa9bff-ade4-410a-b637-b2276d181816 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-92fa9bff-ade4-410a-b637-b2276d181816 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-92fa9bff-ade4-410a-b637-b2276d181816 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-92fa9bff-ade4-410a-b637-b2276d181816 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-92fa9bff-ade4-410a-b637-b2276d181816 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-92fa9bff-ade4-410a-b637-b2276d181816 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:50 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-92fa9bff-ade4-410a-b637-b2276d181816 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "POST /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.412594 Apr 17 10:45:50 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 176/554] 10.0.0.210 () {66 vars in 1441 bytes} [Mon Apr 17 10:45:50 2023] POST /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b/os-volume_attachments => generated 188 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 10:45:50 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-a9036b6b-830d-4626-9368-25c567659b48 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:45:50 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-a9036b6b-830d-4626-9368-25c567659b48 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:45:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a9036b6b-830d-4626-9368-25c567659b48 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a9036b6b-830d-4626-9368-25c567659b48 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a9036b6b-830d-4626-9368-25c567659b48 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a9036b6b-830d-4626-9368-25c567659b48 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a9036b6b-830d-4626-9368-25c567659b48 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a9036b6b-830d-4626-9368-25c567659b48 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:51 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-a9036b6b-830d-4626-9368-25c567659b48 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b/os-volume_attachments/79f52f23-7af1-4f57-9976-222fc404e821" status: 202 len: 0 microversion: 2.20 time: 0.221989 Apr 17 10:45:51 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 192/555] 10.0.0.210 () {64 vars in 1534 bytes} [Mon Apr 17 10:45:50 2023] DELETE /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b/os-volume_attachments/79f52f23-7af1-4f57-9976-222fc404e821 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:45:51 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:45:51 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:45:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:51 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=72743) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 17 10:45:51 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-e80f5b64-d624-4056-99a7-2fce0bd30295 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "POST /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b/action" status: 202 len: 0 microversion: 2.20 time: 0.105059 Apr 17 10:45:51 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 188/556] 10.0.0.210 () {66 vars in 1396 bytes} [Mon Apr 17 10:45:51 2023] POST /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:45:51 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-ebfcee0b-07ac-4a86-af47-42f19b2a4041 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:45:51 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-ebfcee0b-07ac-4a86-af47-42f19b2a4041 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:45:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ebfcee0b-07ac-4a86-af47-42f19b2a4041 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ebfcee0b-07ac-4a86-af47-42f19b2a4041 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ebfcee0b-07ac-4a86-af47-42f19b2a4041 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ebfcee0b-07ac-4a86-af47-42f19b2a4041 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ebfcee0b-07ac-4a86-af47-42f19b2a4041 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ebfcee0b-07ac-4a86-af47-42f19b2a4041 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:51 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-ebfcee0b-07ac-4a86-af47-42f19b2a4041 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:45:51 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-ebfcee0b-07ac-4a86-af47-42f19b2a4041 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:45:51 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-ebfcee0b-07ac-4a86-af47-42f19b2a4041 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:45:51 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-ebfcee0b-07ac-4a86-af47-42f19b2a4041 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b" status: 200 len: 1661 microversion: 2.20 time: 0.221998 Apr 17 10:45:51 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 177/557] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:45:51 2023] GET /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b => generated 1661 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:45:52 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-e521f0a1-d09a-4b0d-bbb6-eac67c6508aa tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:45:52 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-e521f0a1-d09a-4b0d-bbb6-eac67c6508aa tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:45:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e521f0a1-d09a-4b0d-bbb6-eac67c6508aa tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e521f0a1-d09a-4b0d-bbb6-eac67c6508aa tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e521f0a1-d09a-4b0d-bbb6-eac67c6508aa tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e521f0a1-d09a-4b0d-bbb6-eac67c6508aa tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e521f0a1-d09a-4b0d-bbb6-eac67c6508aa tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e521f0a1-d09a-4b0d-bbb6-eac67c6508aa tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:52 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-e521f0a1-d09a-4b0d-bbb6-eac67c6508aa tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9862432f87f4500a46f32a0b27d54d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a17ec3e1b314acbb701f2d2d27d0560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:45:52 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-e521f0a1-d09a-4b0d-bbb6-eac67c6508aa tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3" status: 200 len: 1537 microversion: 2.1 time: 0.316874 Apr 17 10:45:52 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 193/558] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:45:52 2023] GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3 => generated 1537 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 17 10:45:53 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-1cd1116d-4d19-4651-be85-a7237e6dcb7a req-b12b19ab-5671-4de5-a043-f897fb6580ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "288bc9dc-1698-4ca9-a670-5e219c04202b", "tag": "8541d98c-fcb7-4f1a-904c-97db8145dd29"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:45:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-1cd1116d-4d19-4651-be85-a7237e6dcb7a req-b12b19ab-5671-4de5-a043-f897fb6580ba service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-1cd1116d-4d19-4651-be85-a7237e6dcb7a req-b12b19ab-5671-4de5-a043-f897fb6580ba service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-1cd1116d-4d19-4651-be85-a7237e6dcb7a req-b12b19ab-5671-4de5-a043-f897fb6580ba service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:53 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-1cd1116d-4d19-4651-be85-a7237e6dcb7a req-b12b19ab-5671-4de5-a043-f897fb6580ba service nova] Creating event network-changed:8541d98c-fcb7-4f1a-904c-97db8145dd29 for instance 288bc9dc-1698-4ca9-a670-5e219c04202b on user Apr 17 10:45:53 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-1cd1116d-4d19-4651-be85-a7237e6dcb7a req-b12b19ab-5671-4de5-a043-f897fb6580ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030709 Apr 17 10:45:53 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 189/559] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:45:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:45:59 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-67940763-756e-4bcf-9215-ac5f4c3d9f4f req-2d5a2365-3580-4a2a-b781-a026086486bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "288bc9dc-1698-4ca9-a670-5e219c04202b", "name": "network-vif-plugged", "status": "completed", "tag": "8541d98c-fcb7-4f1a-904c-97db8145dd29"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:45:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-67940763-756e-4bcf-9215-ac5f4c3d9f4f req-2d5a2365-3580-4a2a-b781-a026086486bc service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:45:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-67940763-756e-4bcf-9215-ac5f4c3d9f4f req-2d5a2365-3580-4a2a-b781-a026086486bc service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:45:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-67940763-756e-4bcf-9215-ac5f4c3d9f4f req-2d5a2365-3580-4a2a-b781-a026086486bc service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:45:59 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-67940763-756e-4bcf-9215-ac5f4c3d9f4f req-2d5a2365-3580-4a2a-b781-a026086486bc service nova] Creating event network-vif-plugged:8541d98c-fcb7-4f1a-904c-97db8145dd29 for instance 288bc9dc-1698-4ca9-a670-5e219c04202b on user Apr 17 10:45:59 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-67940763-756e-4bcf-9215-ac5f4c3d9f4f req-2d5a2365-3580-4a2a-b781-a026086486bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033417 Apr 17 10:45:59 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 178/560] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:45:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:46:00 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-9de5e4c3-3c1a-46f6-93d5-aced269c0b95 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:46:00 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-9de5e4c3-3c1a-46f6-93d5-aced269c0b95 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:46:00 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9de5e4c3-3c1a-46f6-93d5-aced269c0b95 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:00 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9de5e4c3-3c1a-46f6-93d5-aced269c0b95 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:00 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9de5e4c3-3c1a-46f6-93d5-aced269c0b95 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:00 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9de5e4c3-3c1a-46f6-93d5-aced269c0b95 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:00 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9de5e4c3-3c1a-46f6-93d5-aced269c0b95 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:00 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9de5e4c3-3c1a-46f6-93d5-aced269c0b95 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:00 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-9de5e4c3-3c1a-46f6-93d5-aced269c0b95 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae91492cb6f342f58e250622e2a3ac11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b309bb2b37284020b81369ec89397374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:46:00 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-9de5e4c3-3c1a-46f6-93d5-aced269c0b95 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9174e76f-1f0e-431c-b190-cb857eead406" status: 200 len: 1487 microversion: 2.1 time: 0.534111 Apr 17 10:46:00 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 194/561] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:46:00 2023] GET /compute/v2.1/servers/9174e76f-1f0e-431c-b190-cb857eead406 => generated 1487 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:46:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-75b72bb2-90da-4b26-b507-87df8c5c4a71 req-ab26b637-83aa-496d-b2df-7ffa27b26783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "288bc9dc-1698-4ca9-a670-5e219c04202b", "name": "network-vif-plugged", "status": "completed", "tag": "8541d98c-fcb7-4f1a-904c-97db8145dd29"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:46:01 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-75b72bb2-90da-4b26-b507-87df8c5c4a71 req-ab26b637-83aa-496d-b2df-7ffa27b26783 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:01 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-75b72bb2-90da-4b26-b507-87df8c5c4a71 req-ab26b637-83aa-496d-b2df-7ffa27b26783 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:01 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-75b72bb2-90da-4b26-b507-87df8c5c4a71 req-ab26b637-83aa-496d-b2df-7ffa27b26783 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:01 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-75b72bb2-90da-4b26-b507-87df8c5c4a71 req-ab26b637-83aa-496d-b2df-7ffa27b26783 service nova] Creating event network-vif-plugged:8541d98c-fcb7-4f1a-904c-97db8145dd29 for instance 288bc9dc-1698-4ca9-a670-5e219c04202b on user Apr 17 10:46:01 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-75b72bb2-90da-4b26-b507-87df8c5c4a71 req-ab26b637-83aa-496d-b2df-7ffa27b26783 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032754 Apr 17 10:46:01 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 190/562] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:46:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:46:15 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=8 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:46:15 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:46:15 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-f6ae97ba-560b-459c-a793-100b2948d4fa tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:46:15 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-f6ae97ba-560b-459c-a793-100b2948d4fa tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:46:15 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f6ae97ba-560b-459c-a793-100b2948d4fa tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:15 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f6ae97ba-560b-459c-a793-100b2948d4fa tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:15 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f6ae97ba-560b-459c-a793-100b2948d4fa tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:15 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f6ae97ba-560b-459c-a793-100b2948d4fa tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:15 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f6ae97ba-560b-459c-a793-100b2948d4fa tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:15 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f6ae97ba-560b-459c-a793-100b2948d4fa tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:16 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-f6ae97ba-560b-459c-a793-100b2948d4fa tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:46:16 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-f6ae97ba-560b-459c-a793-100b2948d4fa tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 200 len: 1537 microversion: 2.1 time: 0.238503 Apr 17 10:46:16 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 179/563] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:46:15 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 1537 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:46:19 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-181b6579-7a41-4bbe-956f-1b82dbce63b0 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:46:19 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-181b6579-7a41-4bbe-956f-1b82dbce63b0 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:46:19 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=9 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:46:19 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:46:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-181b6579-7a41-4bbe-956f-1b82dbce63b0 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-181b6579-7a41-4bbe-956f-1b82dbce63b0 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-181b6579-7a41-4bbe-956f-1b82dbce63b0 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-181b6579-7a41-4bbe-956f-1b82dbce63b0 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-181b6579-7a41-4bbe-956f-1b82dbce63b0 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-181b6579-7a41-4bbe-956f-1b82dbce63b0 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:19 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-181b6579-7a41-4bbe-956f-1b82dbce63b0 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708740584a3d488da0ee13e5f8299b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84cd384dfcbb4739b9694704c1fad001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:46:19 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-181b6579-7a41-4bbe-956f-1b82dbce63b0 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d61e9333-fe01-4a9e-abab-ef31ba6d4173" status: 200 len: 1536 microversion: 2.1 time: 0.227912 Apr 17 10:46:19 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 195/564] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:46:19 2023] GET /compute/v2.1/servers/d61e9333-fe01-4a9e-abab-ef31ba6d4173 => generated 1536 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:46:21 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:46:21 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:46:21 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-d354b57d-352e-4f03-9350-bd2c6fb822b1 req-a46534bc-fcf6-45bd-87a2-a4cec83d0610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d61e9333-fe01-4a9e-abab-ef31ba6d4173", "tag": "481e24d2-75a9-47c3-8d22-8573d260e7d3"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:46:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-d354b57d-352e-4f03-9350-bd2c6fb822b1 req-a46534bc-fcf6-45bd-87a2-a4cec83d0610 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-d354b57d-352e-4f03-9350-bd2c6fb822b1 req-a46534bc-fcf6-45bd-87a2-a4cec83d0610 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-d354b57d-352e-4f03-9350-bd2c6fb822b1 req-a46534bc-fcf6-45bd-87a2-a4cec83d0610 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:21 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-d354b57d-352e-4f03-9350-bd2c6fb822b1 req-a46534bc-fcf6-45bd-87a2-a4cec83d0610 service nova] Creating event network-changed:481e24d2-75a9-47c3-8d22-8573d260e7d3 for instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 on user Apr 17 10:46:21 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-d354b57d-352e-4f03-9350-bd2c6fb822b1 req-a46534bc-fcf6-45bd-87a2-a4cec83d0610 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086261 Apr 17 10:46:21 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 191/565] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:46:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:46:21 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7668fb8a-411e-4774-87c2-7029f4aa44ae"}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:46:21 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:46:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:22 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-debc0e91-f714-4ee6-93f7-9df5fd9b8ec5 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d61e9333-fe01-4a9e-abab-ef31ba6d4173/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279888 Apr 17 10:46:22 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 180/566] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Apr 17 10:46:21 2023] POST /compute/v2.1/servers/d61e9333-fe01-4a9e-abab-ef31ba6d4173/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:46:30 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:46:30 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:46:30 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:46:30 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:46:30 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:30 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:30 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:30 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:30 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:30 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:31 user devstack@n-api.service[72745]: DEBUG nova.objects.instance [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lazy-loading 'services' on Instance uuid d61e9333-fe01-4a9e-abab-ef31ba6d4173 {{(pid=72745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 10:46:31 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-79b4b56b-9b5d-4eab-bb1b-a4ae53868002 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d61e9333-fe01-4a9e-abab-ef31ba6d4173/os-volume_attachments/7668fb8a-411e-4774-87c2-7029f4aa44ae" status: 202 len: 0 microversion: 2.1 time: 0.175072 Apr 17 10:46:31 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 196/567] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Apr 17 10:46:30 2023] DELETE /compute/v2.1/servers/d61e9333-fe01-4a9e-abab-ef31ba6d4173/os-volume_attachments/7668fb8a-411e-4774-87c2-7029f4aa44ae => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:46:31 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-542c4782-c4c7-4819-bcde-b56e30e98fcd tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:46:31 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-542c4782-c4c7-4819-bcde-b56e30e98fcd tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:46:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-542c4782-c4c7-4819-bcde-b56e30e98fcd tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-542c4782-c4c7-4819-bcde-b56e30e98fcd tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-542c4782-c4c7-4819-bcde-b56e30e98fcd tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-542c4782-c4c7-4819-bcde-b56e30e98fcd tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-542c4782-c4c7-4819-bcde-b56e30e98fcd tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-542c4782-c4c7-4819-bcde-b56e30e98fcd tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:31 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-542c4782-c4c7-4819-bcde-b56e30e98fcd tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d61e9333-fe01-4a9e-abab-ef31ba6d4173/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055564 Apr 17 10:46:31 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 192/568] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:46:31 2023] GET /compute/v2.1/servers/d61e9333-fe01-4a9e-abab-ef31ba6d4173/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:46:41 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=4 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:46:41 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:46:41 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-4439ff2f-ae7f-42f5-a63e-de61e4f2b1de tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:46:41 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-4439ff2f-ae7f-42f5-a63e-de61e4f2b1de tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:46:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-4439ff2f-ae7f-42f5-a63e-de61e4f2b1de tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-4439ff2f-ae7f-42f5-a63e-de61e4f2b1de tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-4439ff2f-ae7f-42f5-a63e-de61e4f2b1de tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-4439ff2f-ae7f-42f5-a63e-de61e4f2b1de tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-4439ff2f-ae7f-42f5-a63e-de61e4f2b1de tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-4439ff2f-ae7f-42f5-a63e-de61e4f2b1de tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:41 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-4439ff2f-ae7f-42f5-a63e-de61e4f2b1de tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:46:41 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-4439ff2f-ae7f-42f5-a63e-de61e4f2b1de tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:46:41 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-4439ff2f-ae7f-42f5-a63e-de61e4f2b1de tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:46:41 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-4439ff2f-ae7f-42f5-a63e-de61e4f2b1de tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b" status: 200 len: 1706 microversion: 2.20 time: 0.246998 Apr 17 10:46:41 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 181/569] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:46:41 2023] GET /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b => generated 1706 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 17 10:46:44 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:46:44 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:46:44 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-3e851347-25c8-4854-a16f-3bd318d5499d tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1029973184", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "66764afd-311a-41a0-a068-b2937b23acba", "destination_type": "local"}, {"source_type": "volume", "uuid": "0ca3a890-b701-475a-bbf7-39145d902860", "destination_type": "invalid"}], "networks": [{"uuid": "d72c00d6-55cf-4a6c-9d41-f5bbe89865d8"}]}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:46:44 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-3e851347-25c8-4854-a16f-3bd318d5499d tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Request method failure captured: Apr 17 10:46:44 user devstack@n-api.service[72745]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 17 10:46:44 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:46:44 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:46:44 user devstack@n-api.service[72745]: Connection: close Apr 17 10:46:44 user devstack@n-api.service[72745]: Content-Length: 494 Apr 17 10:46:44 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:46:44 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:46:44 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:46:44 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:46:44 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSHHBSxJU3GfcgBo4oxop3Utq3Ux8-8rgyX-78CWsY7DpxBUrhJrx5DFmxVDOSS779NXyNEKXanmdpZXAZeKA-EO7YcmTrVyRLEcXoVn2i1Ne2ZaWSUvSM9rm-nfHcTK7GVYQQzRVOzwsgq1B2sVUsCajeEIUJ_VlPPhRLKnXmI48Yo Apr 17 10:46:44 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:46:44 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:46:44 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:46:44 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:46:44 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:46:44 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:46:44 user devstack@n-api.service[72745]: X-Project-Id: a8b831c3b6c244dda1821583a6b8cd08 Apr 17 10:46:44 user devstack@n-api.service[72745]: X-Project-Name: tempest-ServersNegativeTestJSON-812869679 Apr 17 10:46:44 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:46:44 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:46:44 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a8b831c3b6c244dda1821583a6b8cd08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a8b831c3b6c244dda1821583a6b8cd08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a8b831c3b6c244dda1821583a6b8cd08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:46:44 user devstack@n-api.service[72745]: X-Tenant: tempest-ServersNegativeTestJSON-812869679 Apr 17 10:46:44 user devstack@n-api.service[72745]: X-Tenant-Id: a8b831c3b6c244dda1821583a6b8cd08 Apr 17 10:46:44 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-812869679 Apr 17 10:46:44 user devstack@n-api.service[72745]: X-User: tempest-ServersNegativeTestJSON-812869679-project-member Apr 17 10:46:44 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:46:44 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:46:44 user devstack@n-api.service[72745]: X-User-Id: 1e61a5e172c34636b183ef9c84b714d8 Apr 17 10:46:44 user devstack@n-api.service[72745]: X-User-Name: tempest-ServersNegativeTestJSON-812869679-project-member Apr 17 10:46:44 user devstack@n-api.service[72745]: Apr 17 10:46:44 user devstack@n-api.service[72745]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1029973184", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "66764afd-311a-41a0-a068-b2937b23acba", "destination_type": "local"}, {"source_type": "volume", "uuid": "0ca3a890-b701-475a-bbf7-39145d902860", "destination_type": "invalid"}], "networks": [{"uuid": "d72c00d6-55cf-4a6c-9d41-f5bbe89865d8"}]}} Apr 17 10:46:44 user devstack@n-api.service[72745]: method: > Apr 17 10:46:44 user devstack@n-api.service[72745]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 17 10:46:44 user devstack@n-api.service[72745]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1029973184', 'imageRef': '66764afd-311a-41a0-a068-b2937b23acba', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '66764afd-311a-41a0-a068-b2937b23acba', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '0ca3a890-b701-475a-bbf7-39145d902860', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'd72c00d6-55cf-4a6c-9d41-f5bbe89865d8'}]}}} Apr 17 10:46:44 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise error Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi 'invalid' Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 17 10:46:44 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:46:44 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-3e851347-25c8-4854-a16f-3bd318d5499d tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:46:44 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-3e851347-25c8-4854-a16f-3bd318d5499d tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.018375 Apr 17 10:46:44 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 197/570] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:46:44 2023] POST /compute/v2.1/servers => generated 155 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 17 10:46:44 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-253f0b2f-954a-4ed1-b57c-86c676f65463 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:46:44 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-253f0b2f-954a-4ed1-b57c-86c676f65463 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:46:44 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=4 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:46:44 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=8 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:46:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-253f0b2f-954a-4ed1-b57c-86c676f65463 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-253f0b2f-954a-4ed1-b57c-86c676f65463 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-253f0b2f-954a-4ed1-b57c-86c676f65463 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-253f0b2f-954a-4ed1-b57c-86c676f65463 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-253f0b2f-954a-4ed1-b57c-86c676f65463 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-253f0b2f-954a-4ed1-b57c-86c676f65463 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:44 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-253f0b2f-954a-4ed1-b57c-86c676f65463 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e61a5e172c34636b183ef9c84b714d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b831c3b6c244dda1821583a6b8cd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:46:44 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-253f0b2f-954a-4ed1-b57c-86c676f65463 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e03807e-942b-4155-835b-b1c86f5b80f5" status: 200 len: 1494 microversion: 2.1 time: 0.230495 Apr 17 10:46:44 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 193/571] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:46:44 2023] GET /compute/v2.1/servers/5e03807e-942b-4155-835b-b1c86f5b80f5 => generated 1494 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:46:49 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1712014270", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "66764afd-311a-41a0-a068-b2937b23acba", "destination_type": "volume"}], "networks": [{"uuid": "5678ceef-3151-4d42-9106-9996eafd66f1"}]}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:46:49 user devstack@n-api.service[72744]: DEBUG nova.network.neutron [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] validate_networks() for [('5678ceef-3151-4d42-9106-9996eafd66f1', None, None, None, None, None)] {{(pid=72744) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:46:49 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Flavor limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:46:49 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Image limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:46:49 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Flavor pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:46:49 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Image pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:46:49 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:46:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:49 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Getting quotas for project faab4afa0ddf45578232627c2fac2ff8. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:46:49 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Getting quotas for user d8cb73d24d324903a625e4782270120e and project faab4afa0ddf45578232627c2fac2ff8. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:46:49 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Going to run 1 instances... {{(pid=72744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:46:49 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=72744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:46:49 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-731c4d02-bbdb-434c-98f3-6c2e88a1b926 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.722920 Apr 17 10:46:49 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 182/572] 10.0.0.210 () {66 vars in 1265 bytes} [Mon Apr 17 10:46:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 17 10:46:49 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-b3939e53-af9f-4f62-9599-59c9eba01818 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:46:49 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-b3939e53-af9f-4f62-9599-59c9eba01818 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:46:49 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-b3939e53-af9f-4f62-9599-59c9eba01818 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:46:49 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-b3939e53-af9f-4f62-9599-59c9eba01818 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:46:49 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-b3939e53-af9f-4f62-9599-59c9eba01818 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:46:49 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-b3939e53-af9f-4f62-9599-59c9eba01818 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e198ad00-927f-45e1-9f14-828d56ce3393" status: 200 len: 1395 microversion: 2.87 time: 0.081345 Apr 17 10:46:49 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 198/573] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:46:49 2023] GET /compute/v2.1/servers/e198ad00-927f-45e1-9f14-828d56ce3393 => generated 1395 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:46:52 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-eadc8e4c-e160-4a3f-933a-e8cc0f1435d2 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:46:52 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-eadc8e4c-e160-4a3f-933a-e8cc0f1435d2 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:46:52 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-eadc8e4c-e160-4a3f-933a-e8cc0f1435d2 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:52 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-eadc8e4c-e160-4a3f-933a-e8cc0f1435d2 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:52 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-eadc8e4c-e160-4a3f-933a-e8cc0f1435d2 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:52 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-eadc8e4c-e160-4a3f-933a-e8cc0f1435d2 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:52 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-eadc8e4c-e160-4a3f-933a-e8cc0f1435d2 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:52 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-eadc8e4c-e160-4a3f-933a-e8cc0f1435d2 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:52 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-2937c03d-ce84-4b31-b5ed-d50d94604632 req-365f85fd-1978-4bd3-a99a-7b3a1405c878 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e198ad00-927f-45e1-9f14-828d56ce3393", "tag": "8b03fa35-eaab-40ea-a06b-afa4bd410981"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:46:52 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-2937c03d-ce84-4b31-b5ed-d50d94604632 req-365f85fd-1978-4bd3-a99a-7b3a1405c878 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:52 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-2937c03d-ce84-4b31-b5ed-d50d94604632 req-365f85fd-1978-4bd3-a99a-7b3a1405c878 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:52 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-2937c03d-ce84-4b31-b5ed-d50d94604632 req-365f85fd-1978-4bd3-a99a-7b3a1405c878 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:52 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-2937c03d-ce84-4b31-b5ed-d50d94604632 req-365f85fd-1978-4bd3-a99a-7b3a1405c878 service nova] Creating event network-changed:8b03fa35-eaab-40ea-a06b-afa4bd410981 for instance e198ad00-927f-45e1-9f14-828d56ce3393 on user Apr 17 10:46:52 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-2937c03d-ce84-4b31-b5ed-d50d94604632 req-365f85fd-1978-4bd3-a99a-7b3a1405c878 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034620 Apr 17 10:46:52 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 183/574] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:46:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:46:52 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-eadc8e4c-e160-4a3f-933a-e8cc0f1435d2 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.260643 Apr 17 10:46:52 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 194/575] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 17 10:46:52 2023] GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/os-interface => generated 283 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:46:53 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-f6d59946-b056-46b7-bdc1-1b49ad867e79 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:46:53 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-f6d59946-b056-46b7-bdc1-1b49ad867e79 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:46:53 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f6d59946-b056-46b7-bdc1-1b49ad867e79 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:53 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f6d59946-b056-46b7-bdc1-1b49ad867e79 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:53 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f6d59946-b056-46b7-bdc1-1b49ad867e79 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:53 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f6d59946-b056-46b7-bdc1-1b49ad867e79 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:53 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f6d59946-b056-46b7-bdc1-1b49ad867e79 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:53 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f6d59946-b056-46b7-bdc1-1b49ad867e79 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:53 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-f6d59946-b056-46b7-bdc1-1b49ad867e79 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/ips" status: 200 len: 104 microversion: 2.1 time: 0.041634 Apr 17 10:46:53 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 199/576] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 17 10:46:53 2023] GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/ips => generated 104 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:46:54 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-a582f6fe-833a-4d9e-ba2a-6abbf0e1a6fd req-0a3454cd-38e9-4459-82a3-6e471c5f6a17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44e80daa-73f1-4b84-8cbc-3dd0ea159da3", "tag": "20b83dbf-57d7-4d67-b030-53b0d12f01e2"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:46:54 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-a582f6fe-833a-4d9e-ba2a-6abbf0e1a6fd req-0a3454cd-38e9-4459-82a3-6e471c5f6a17 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:54 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-a582f6fe-833a-4d9e-ba2a-6abbf0e1a6fd req-0a3454cd-38e9-4459-82a3-6e471c5f6a17 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:54 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-a582f6fe-833a-4d9e-ba2a-6abbf0e1a6fd req-0a3454cd-38e9-4459-82a3-6e471c5f6a17 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:54 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-a582f6fe-833a-4d9e-ba2a-6abbf0e1a6fd req-0a3454cd-38e9-4459-82a3-6e471c5f6a17 service nova] Creating event network-changed:20b83dbf-57d7-4d67-b030-53b0d12f01e2 for instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 on user Apr 17 10:46:54 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-a582f6fe-833a-4d9e-ba2a-6abbf0e1a6fd req-0a3454cd-38e9-4459-82a3-6e471c5f6a17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030595 Apr 17 10:46:54 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 184/577] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:46:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:46:56 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c826238-b1c2-4c27-8619-39a2fcc30547"}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:46:56 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:46:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:46:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:46:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:46:56 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-b2c771ed-c3a9-485f-b4f3-51b7450f9be9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "POST /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296774 Apr 17 10:46:56 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 195/578] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Apr 17 10:46:56 2023] POST /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:47:01 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:47:01 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:47:01 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:01 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:01 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Going to try to terminate instance {{(pid=72745) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:47:01 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-58c2cde0-2ef2-463d-a183-126151f4c77d tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9174e76f-1f0e-431c-b190-cb857eead406" status: 204 len: 0 microversion: 2.1 time: 0.118201 Apr 17 10:47:01 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 200/579] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:47:01 2023] DELETE /compute/v2.1/servers/9174e76f-1f0e-431c-b190-cb857eead406 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:47:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-feb21cd3-8efb-4406-8896-05b142c68c54 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:47:01 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-feb21cd3-8efb-4406-8896-05b142c68c54 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:01 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:47:01 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:47:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-feb21cd3-8efb-4406-8896-05b142c68c54 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-feb21cd3-8efb-4406-8896-05b142c68c54 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-feb21cd3-8efb-4406-8896-05b142c68c54 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-feb21cd3-8efb-4406-8896-05b142c68c54 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-feb21cd3-8efb-4406-8896-05b142c68c54 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-feb21cd3-8efb-4406-8896-05b142c68c54 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-3f6e5e3f-836d-4bb7-baac-2fb0c73563c9 req-4244000d-6c08-491b-8304-8c1f2788cb3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9174e76f-1f0e-431c-b190-cb857eead406", "name": "network-vif-unplugged", "status": "completed", "tag": "d988d5c2-1a5a-425e-8dca-eee7b1783eae"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:47:01 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-3f6e5e3f-836d-4bb7-baac-2fb0c73563c9 req-4244000d-6c08-491b-8304-8c1f2788cb3f service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:01 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-3f6e5e3f-836d-4bb7-baac-2fb0c73563c9 req-4244000d-6c08-491b-8304-8c1f2788cb3f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:01 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-3f6e5e3f-836d-4bb7-baac-2fb0c73563c9 req-4244000d-6c08-491b-8304-8c1f2788cb3f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:01 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-feb21cd3-8efb-4406-8896-05b142c68c54 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae91492cb6f342f58e250622e2a3ac11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b309bb2b37284020b81369ec89397374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:47:01 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-3f6e5e3f-836d-4bb7-baac-2fb0c73563c9 req-4244000d-6c08-491b-8304-8c1f2788cb3f service nova] Creating event network-vif-unplugged:d988d5c2-1a5a-425e-8dca-eee7b1783eae for instance 9174e76f-1f0e-431c-b190-cb857eead406 on user Apr 17 10:47:01 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-feb21cd3-8efb-4406-8896-05b142c68c54 tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9174e76f-1f0e-431c-b190-cb857eead406" status: 200 len: 1493 microversion: 2.1 time: 0.266145 Apr 17 10:47:01 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-3f6e5e3f-836d-4bb7-baac-2fb0c73563c9 req-4244000d-6c08-491b-8304-8c1f2788cb3f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034690 Apr 17 10:47:01 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 185/580] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:47:01 2023] GET /compute/v2.1/servers/9174e76f-1f0e-431c-b190-cb857eead406 => generated 1493 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:47:01 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 196/581] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:47:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:47:02 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-766719cd-d73b-4d36-a72b-e2da740e8ef1 req-d11e04df-fa15-4c3d-8add-dad596b77d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9174e76f-1f0e-431c-b190-cb857eead406", "name": "network-vif-deleted", "tag": "d988d5c2-1a5a-425e-8dca-eee7b1783eae"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:47:02 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-766719cd-d73b-4d36-a72b-e2da740e8ef1 req-d11e04df-fa15-4c3d-8add-dad596b77d3f service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:02 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-766719cd-d73b-4d36-a72b-e2da740e8ef1 req-d11e04df-fa15-4c3d-8add-dad596b77d3f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:02 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-766719cd-d73b-4d36-a72b-e2da740e8ef1 req-d11e04df-fa15-4c3d-8add-dad596b77d3f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:02 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-766719cd-d73b-4d36-a72b-e2da740e8ef1 req-d11e04df-fa15-4c3d-8add-dad596b77d3f service nova] Creating event network-vif-deleted:d988d5c2-1a5a-425e-8dca-eee7b1783eae for instance 9174e76f-1f0e-431c-b190-cb857eead406 on user Apr 17 10:47:02 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-766719cd-d73b-4d36-a72b-e2da740e8ef1 req-d11e04df-fa15-4c3d-8add-dad596b77d3f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032623 Apr 17 10:47:02 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 201/582] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:47:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:47:03 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-d882af26-8bb3-4e40-be55-7a2f7baa7f86 req-72699468-52bb-40ce-b19e-aebb6211e58f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9174e76f-1f0e-431c-b190-cb857eead406", "name": "network-vif-plugged", "status": "completed", "tag": "d988d5c2-1a5a-425e-8dca-eee7b1783eae"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:47:03 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-d882af26-8bb3-4e40-be55-7a2f7baa7f86 req-72699468-52bb-40ce-b19e-aebb6211e58f service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:03 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-d882af26-8bb3-4e40-be55-7a2f7baa7f86 req-72699468-52bb-40ce-b19e-aebb6211e58f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:03 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-d882af26-8bb3-4e40-be55-7a2f7baa7f86 req-72699468-52bb-40ce-b19e-aebb6211e58f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:03 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-d882af26-8bb3-4e40-be55-7a2f7baa7f86 req-72699468-52bb-40ce-b19e-aebb6211e58f service nova] Creating event network-vif-plugged:d988d5c2-1a5a-425e-8dca-eee7b1783eae for instance 9174e76f-1f0e-431c-b190-cb857eead406 on user Apr 17 10:47:03 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-d882af26-8bb3-4e40-be55-7a2f7baa7f86 req-72699468-52bb-40ce-b19e-aebb6211e58f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033815 Apr 17 10:47:03 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 186/583] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:47:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:47:04 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-04adcb42-d9c0-41cf-9baf-6d4c8e70c892 req-ad98ac57-8f7c-48a3-80cb-2ff627c5a821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e198ad00-927f-45e1-9f14-828d56ce3393", "name": "network-vif-plugged", "status": "completed", "tag": "8b03fa35-eaab-40ea-a06b-afa4bd410981"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:47:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-04adcb42-d9c0-41cf-9baf-6d4c8e70c892 req-ad98ac57-8f7c-48a3-80cb-2ff627c5a821 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-04adcb42-d9c0-41cf-9baf-6d4c8e70c892 req-ad98ac57-8f7c-48a3-80cb-2ff627c5a821 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-04adcb42-d9c0-41cf-9baf-6d4c8e70c892 req-ad98ac57-8f7c-48a3-80cb-2ff627c5a821 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:04 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-04adcb42-d9c0-41cf-9baf-6d4c8e70c892 req-ad98ac57-8f7c-48a3-80cb-2ff627c5a821 service nova] Creating event network-vif-plugged:8b03fa35-eaab-40ea-a06b-afa4bd410981 for instance e198ad00-927f-45e1-9f14-828d56ce3393 on user Apr 17 10:47:04 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-04adcb42-d9c0-41cf-9baf-6d4c8e70c892 req-ad98ac57-8f7c-48a3-80cb-2ff627c5a821 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036928 Apr 17 10:47:04 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 197/584] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:47:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:47:05 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-9bc19990-9850-46b8-8b4d-b84e669bda97 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:47:05 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-9bc19990-9850-46b8-8b4d-b84e669bda97 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:05 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9bc19990-9850-46b8-8b4d-b84e669bda97 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:05 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9bc19990-9850-46b8-8b4d-b84e669bda97 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:05 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9bc19990-9850-46b8-8b4d-b84e669bda97 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:05 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9bc19990-9850-46b8-8b4d-b84e669bda97 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:05 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9bc19990-9850-46b8-8b4d-b84e669bda97 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:05 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9bc19990-9850-46b8-8b4d-b84e669bda97 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:05 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-9bc19990-9850-46b8-8b4d-b84e669bda97 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041513 Apr 17 10:47:05 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 202/585] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:47:05 2023] GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:47:05 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-62ccf54d-38ba-42cf-a8e1-2f775a449f22 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:47:05 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-62ccf54d-38ba-42cf-a8e1-2f775a449f22 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-62ccf54d-38ba-42cf-a8e1-2f775a449f22 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-62ccf54d-38ba-42cf-a8e1-2f775a449f22 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-62ccf54d-38ba-42cf-a8e1-2f775a449f22 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-62ccf54d-38ba-42cf-a8e1-2f775a449f22 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-62ccf54d-38ba-42cf-a8e1-2f775a449f22 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-62ccf54d-38ba-42cf-a8e1-2f775a449f22 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:05 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-62ccf54d-38ba-42cf-a8e1-2f775a449f22 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/os-volume_attachments/7c826238-b1c2-4c27-8619-39a2fcc30547" status: 200 len: 194 microversion: 2.1 time: 0.039205 Apr 17 10:47:05 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 187/586] 10.0.0.210 () {62 vars in 1490 bytes} [Mon Apr 17 10:47:05 2023] GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/os-volume_attachments/7c826238-b1c2-4c27-8619-39a2fcc30547 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:47:06 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-c7092419-1d26-424b-9a2e-bf5a2c9291f3 req-bdb7a080-8726-4833-8f0d-be272f88d2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e198ad00-927f-45e1-9f14-828d56ce3393", "name": "network-vif-plugged", "status": "completed", "tag": "8b03fa35-eaab-40ea-a06b-afa4bd410981"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:47:06 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-c7092419-1d26-424b-9a2e-bf5a2c9291f3 req-bdb7a080-8726-4833-8f0d-be272f88d2a4 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:06 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-c7092419-1d26-424b-9a2e-bf5a2c9291f3 req-bdb7a080-8726-4833-8f0d-be272f88d2a4 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:06 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-c7092419-1d26-424b-9a2e-bf5a2c9291f3 req-bdb7a080-8726-4833-8f0d-be272f88d2a4 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:06 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-c7092419-1d26-424b-9a2e-bf5a2c9291f3 req-bdb7a080-8726-4833-8f0d-be272f88d2a4 service nova] Creating event network-vif-plugged:8b03fa35-eaab-40ea-a06b-afa4bd410981 for instance e198ad00-927f-45e1-9f14-828d56ce3393 on user Apr 17 10:47:06 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-c7092419-1d26-424b-9a2e-bf5a2c9291f3 req-bdb7a080-8726-4833-8f0d-be272f88d2a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036151 Apr 17 10:47:06 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 198/587] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:47:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:47:07 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ce28870-51bb-4d74-988a-0bbecf6e1576"}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:47:07 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:08 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-7468d72c-2447-419f-a141-61e336c16724 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "POST /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265864 Apr 17 10:47:08 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 203/588] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Apr 17 10:47:07 2023] POST /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:47:15 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-1350d891-6e7b-4190-950c-c7c879b3c646 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:47:15 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-1350d891-6e7b-4190-950c-c7c879b3c646 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:15 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:47:15 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=26 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:47:15 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1350d891-6e7b-4190-950c-c7c879b3c646 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:15 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1350d891-6e7b-4190-950c-c7c879b3c646 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:15 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1350d891-6e7b-4190-950c-c7c879b3c646 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:15 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1350d891-6e7b-4190-950c-c7c879b3c646 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:15 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1350d891-6e7b-4190-950c-c7c879b3c646 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:15 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1350d891-6e7b-4190-950c-c7c879b3c646 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:15 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-1350d891-6e7b-4190-950c-c7c879b3c646 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045171 Apr 17 10:47:15 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 188/589] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:47:15 2023] GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:47:15 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-bbe8be0f-9363-4823-8fee-420d54d8ed30 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:47:15 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-bbe8be0f-9363-4823-8fee-420d54d8ed30 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:15 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=13 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:47:15 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-bbe8be0f-9363-4823-8fee-420d54d8ed30 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:15 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-bbe8be0f-9363-4823-8fee-420d54d8ed30 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:15 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-bbe8be0f-9363-4823-8fee-420d54d8ed30 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:15 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-bbe8be0f-9363-4823-8fee-420d54d8ed30 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:15 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-bbe8be0f-9363-4823-8fee-420d54d8ed30 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:15 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-bbe8be0f-9363-4823-8fee-420d54d8ed30 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:15 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:47:15 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-bbe8be0f-9363-4823-8fee-420d54d8ed30 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/os-volume_attachments/7c826238-b1c2-4c27-8619-39a2fcc30547" status: 200 len: 194 microversion: 2.1 time: 0.042212 Apr 17 10:47:15 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 199/590] 10.0.0.210 () {62 vars in 1490 bytes} [Mon Apr 17 10:47:15 2023] GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/os-volume_attachments/7c826238-b1c2-4c27-8619-39a2fcc30547 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:47:15 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:47:15 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:15 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:15 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:15 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:15 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:15 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:15 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:15 user devstack@n-api.service[72745]: DEBUG nova.objects.instance [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'services' on Instance uuid 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 {{(pid=72745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 10:47:15 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-a42c827b-c692-4fd8-939c-d2281aee9cf3 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/os-volume_attachments/7c826238-b1c2-4c27-8619-39a2fcc30547" status: 202 len: 0 microversion: 2.1 time: 0.176183 Apr 17 10:47:15 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 204/591] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Apr 17 10:47:15 2023] DELETE /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/os-volume_attachments/7c826238-b1c2-4c27-8619-39a2fcc30547 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:47:16 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-032a8f31-61da-4381-bfae-f410be6b110a tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:47:16 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-032a8f31-61da-4381-bfae-f410be6b110a tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:16 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-032a8f31-61da-4381-bfae-f410be6b110a tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:16 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-032a8f31-61da-4381-bfae-f410be6b110a tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:16 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-032a8f31-61da-4381-bfae-f410be6b110a tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:16 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-032a8f31-61da-4381-bfae-f410be6b110a tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:16 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-032a8f31-61da-4381-bfae-f410be6b110a tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:16 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-032a8f31-61da-4381-bfae-f410be6b110a tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:16 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-032a8f31-61da-4381-bfae-f410be6b110a tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.160339 Apr 17 10:47:16 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 189/592] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 17 10:47:16 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/os-interface => generated 282 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:47:17 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-ba1d8708-37a9-4ba1-b6ac-8d36b0a2149c req-7bac329b-6c56-49fc-97d0-ff6cdcdf3b8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38", "tag": "67386c8f-911d-4398-b449-42af25f6afe3"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:47:17 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-ba1d8708-37a9-4ba1-b6ac-8d36b0a2149c req-7bac329b-6c56-49fc-97d0-ff6cdcdf3b8a service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:17 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-ba1d8708-37a9-4ba1-b6ac-8d36b0a2149c req-7bac329b-6c56-49fc-97d0-ff6cdcdf3b8a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:17 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-ba1d8708-37a9-4ba1-b6ac-8d36b0a2149c req-7bac329b-6c56-49fc-97d0-ff6cdcdf3b8a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:17 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-ba1d8708-37a9-4ba1-b6ac-8d36b0a2149c req-7bac329b-6c56-49fc-97d0-ff6cdcdf3b8a service nova] Creating event network-changed:67386c8f-911d-4398-b449-42af25f6afe3 for instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 on user Apr 17 10:47:17 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-ba1d8708-37a9-4ba1-b6ac-8d36b0a2149c req-7bac329b-6c56-49fc-97d0-ff6cdcdf3b8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039052 Apr 17 10:47:17 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 200/593] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:47:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:47:17 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-b61a95eb-7c2d-4676-8517-91650b50b2c4 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:47:17 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-b61a95eb-7c2d-4676-8517-91650b50b2c4 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b61a95eb-7c2d-4676-8517-91650b50b2c4 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b61a95eb-7c2d-4676-8517-91650b50b2c4 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b61a95eb-7c2d-4676-8517-91650b50b2c4 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b61a95eb-7c2d-4676-8517-91650b50b2c4 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b61a95eb-7c2d-4676-8517-91650b50b2c4 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:17 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b61a95eb-7c2d-4676-8517-91650b50b2c4 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:17 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-b61a95eb-7c2d-4676-8517-91650b50b2c4 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:47:17 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-b61a95eb-7c2d-4676-8517-91650b50b2c4 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 200 len: 1537 microversion: 2.1 time: 0.264626 Apr 17 10:47:17 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 205/594] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:47:17 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 1537 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:47:17 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-a732fabc-b033-427e-8ec2-fe038c6218d5 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:47:17 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-a732fabc-b033-427e-8ec2-fe038c6218d5 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:17 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a732fabc-b033-427e-8ec2-fe038c6218d5 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:17 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a732fabc-b033-427e-8ec2-fe038c6218d5 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:17 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a732fabc-b033-427e-8ec2-fe038c6218d5 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:17 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a732fabc-b033-427e-8ec2-fe038c6218d5 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:17 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a732fabc-b033-427e-8ec2-fe038c6218d5 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:17 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a732fabc-b033-427e-8ec2-fe038c6218d5 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:18 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-a732fabc-b033-427e-8ec2-fe038c6218d5 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:47:18 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-a732fabc-b033-427e-8ec2-fe038c6218d5 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 200 len: 1537 microversion: 2.1 time: 0.237949 Apr 17 10:47:18 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 190/595] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:47:17 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 1537 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:47:18 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-c77ab11c-b543-4245-8b3d-5507d9e97b7b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:47:18 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-c77ab11c-b543-4245-8b3d-5507d9e97b7b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:18 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c77ab11c-b543-4245-8b3d-5507d9e97b7b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:18 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c77ab11c-b543-4245-8b3d-5507d9e97b7b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:18 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c77ab11c-b543-4245-8b3d-5507d9e97b7b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:18 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c77ab11c-b543-4245-8b3d-5507d9e97b7b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:18 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c77ab11c-b543-4245-8b3d-5507d9e97b7b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:18 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c77ab11c-b543-4245-8b3d-5507d9e97b7b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:18 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-c77ab11c-b543-4245-8b3d-5507d9e97b7b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/os-volume_attachments/2ce28870-51bb-4d74-988a-0bbecf6e1576" status: 200 len: 194 microversion: 2.1 time: 0.043842 Apr 17 10:47:18 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 201/596] 10.0.0.210 () {62 vars in 1490 bytes} [Mon Apr 17 10:47:18 2023] GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/os-volume_attachments/2ce28870-51bb-4d74-988a-0bbecf6e1576 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:47:18 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:47:18 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:18 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:18 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:18 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:18 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:18 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:18 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:18 user devstack@n-api.service[72745]: DEBUG nova.objects.instance [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lazy-loading 'services' on Instance uuid 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 {{(pid=72745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 10:47:18 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-5b911249-291e-4548-95ef-26588d10de9c tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/os-volume_attachments/2ce28870-51bb-4d74-988a-0bbecf6e1576" status: 202 len: 0 microversion: 2.1 time: 0.160479 Apr 17 10:47:18 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 206/597] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Apr 17 10:47:18 2023] DELETE /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/os-volume_attachments/2ce28870-51bb-4d74-988a-0bbecf6e1576 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:47:20 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-3b08ede4-564e-45ac-9e5a-98ed47742c00 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:47:20 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-3b08ede4-564e-45ac-9e5a-98ed47742c00 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-3b08ede4-564e-45ac-9e5a-98ed47742c00 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-3b08ede4-564e-45ac-9e5a-98ed47742c00 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-3b08ede4-564e-45ac-9e5a-98ed47742c00 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-3b08ede4-564e-45ac-9e5a-98ed47742c00 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-3b08ede4-564e-45ac-9e5a-98ed47742c00 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-3b08ede4-564e-45ac-9e5a-98ed47742c00 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:20 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-3b08ede4-564e-45ac-9e5a-98ed47742c00 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040984 Apr 17 10:47:20 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 191/598] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:47:20 2023] GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 17 10:47:20 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-79183da8-2855-4a01-a998-67cfd4a15dae tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:47:20 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-79183da8-2855-4a01-a998-67cfd4a15dae tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:20 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-79183da8-2855-4a01-a998-67cfd4a15dae tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:20 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-79183da8-2855-4a01-a998-67cfd4a15dae tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:20 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-79183da8-2855-4a01-a998-67cfd4a15dae tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:20 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-79183da8-2855-4a01-a998-67cfd4a15dae tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:20 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-79183da8-2855-4a01-a998-67cfd4a15dae tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:20 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-79183da8-2855-4a01-a998-67cfd4a15dae tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:20 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-79183da8-2855-4a01-a998-67cfd4a15dae tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045077 Apr 17 10:47:20 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 202/599] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:47:20 2023] GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 17 10:47:20 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:47:20 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:20 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:47:20 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:20 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:20 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:20 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:20 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:20 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:20 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:47:20 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Going to try to terminate instance {{(pid=72745) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:47:20 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-10855562-dcc8-47ed-a226-31a292a30e5e tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3" status: 204 len: 0 microversion: 2.1 time: 0.120101 Apr 17 10:47:20 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 207/600] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:47:20 2023] DELETE /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:47:20 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-ac167c07-8e98-4f74-8739-392890d08ce9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:47:20 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-ac167c07-8e98-4f74-8739-392890d08ce9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ac167c07-8e98-4f74-8739-392890d08ce9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ac167c07-8e98-4f74-8739-392890d08ce9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ac167c07-8e98-4f74-8739-392890d08ce9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ac167c07-8e98-4f74-8739-392890d08ce9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ac167c07-8e98-4f74-8739-392890d08ce9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ac167c07-8e98-4f74-8739-392890d08ce9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:21 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-6990bc10-d4a4-42ab-9719-112b63ddad4d tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:47:21 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-6990bc10-d4a4-42ab-9719-112b63ddad4d tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6990bc10-d4a4-42ab-9719-112b63ddad4d tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6990bc10-d4a4-42ab-9719-112b63ddad4d tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6990bc10-d4a4-42ab-9719-112b63ddad4d tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6990bc10-d4a4-42ab-9719-112b63ddad4d tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6990bc10-d4a4-42ab-9719-112b63ddad4d tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6990bc10-d4a4-42ab-9719-112b63ddad4d tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:21 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-6990bc10-d4a4-42ab-9719-112b63ddad4d tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d61e9333-fe01-4a9e-abab-ef31ba6d4173/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044935 Apr 17 10:47:21 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 203/601] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:47:21 2023] GET /compute/v2.1/servers/d61e9333-fe01-4a9e-abab-ef31ba6d4173/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 17 10:47:21 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-2cb9e29e-6761-4b90-b3c3-3f836c34bc42 req-33bea6a0-6743-4ae5-9be0-2285684687f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44e80daa-73f1-4b84-8cbc-3dd0ea159da3", "name": "network-vif-unplugged", "status": "completed", "tag": "20b83dbf-57d7-4d67-b030-53b0d12f01e2"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:47:21 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-2cb9e29e-6761-4b90-b3c3-3f836c34bc42 req-33bea6a0-6743-4ae5-9be0-2285684687f0 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:21 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-2cb9e29e-6761-4b90-b3c3-3f836c34bc42 req-33bea6a0-6743-4ae5-9be0-2285684687f0 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:21 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-2cb9e29e-6761-4b90-b3c3-3f836c34bc42 req-33bea6a0-6743-4ae5-9be0-2285684687f0 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:21 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-2cb9e29e-6761-4b90-b3c3-3f836c34bc42 req-33bea6a0-6743-4ae5-9be0-2285684687f0 service nova] Creating event network-vif-unplugged:20b83dbf-57d7-4d67-b030-53b0d12f01e2 for instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 on user Apr 17 10:47:21 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-ac167c07-8e98-4f74-8739-392890d08ce9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9862432f87f4500a46f32a0b27d54d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a17ec3e1b314acbb701f2d2d27d0560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:47:21 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-ac167c07-8e98-4f74-8739-392890d08ce9 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3" status: 200 len: 1660 microversion: 2.1 time: 0.341094 Apr 17 10:47:21 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 192/602] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:47:20 2023] GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3 => generated 1660 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:47:21 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-2cb9e29e-6761-4b90-b3c3-3f836c34bc42 req-33bea6a0-6743-4ae5-9be0-2285684687f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036142 Apr 17 10:47:21 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 208/603] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:47:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:47:23 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-59af97ad-f193-4145-8af7-0f61839b60ec req-4195b69b-e0a8-4b3a-87ad-42f8c5766bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44e80daa-73f1-4b84-8cbc-3dd0ea159da3", "name": "network-vif-plugged", "status": "completed", "tag": "20b83dbf-57d7-4d67-b030-53b0d12f01e2"}, {"server_uuid": "44e80daa-73f1-4b84-8cbc-3dd0ea159da3", "name": "network-vif-deleted", "tag": "20b83dbf-57d7-4d67-b030-53b0d12f01e2"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:47:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-59af97ad-f193-4145-8af7-0f61839b60ec req-4195b69b-e0a8-4b3a-87ad-42f8c5766bc6 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-59af97ad-f193-4145-8af7-0f61839b60ec req-4195b69b-e0a8-4b3a-87ad-42f8c5766bc6 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-59af97ad-f193-4145-8af7-0f61839b60ec req-4195b69b-e0a8-4b3a-87ad-42f8c5766bc6 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:23 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-59af97ad-f193-4145-8af7-0f61839b60ec req-4195b69b-e0a8-4b3a-87ad-42f8c5766bc6 service nova] Creating event network-vif-plugged:20b83dbf-57d7-4d67-b030-53b0d12f01e2 for instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 on user Apr 17 10:47:23 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-59af97ad-f193-4145-8af7-0f61839b60ec req-4195b69b-e0a8-4b3a-87ad-42f8c5766bc6 service nova] Creating event network-vif-deleted:20b83dbf-57d7-4d67-b030-53b0d12f01e2 for instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 on user Apr 17 10:47:23 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-59af97ad-f193-4145-8af7-0f61839b60ec req-4195b69b-e0a8-4b3a-87ad-42f8c5766bc6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030809 Apr 17 10:47:23 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 204/604] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:47:23 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:47:24 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-1208638594"}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:47:24 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:25 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-48f87b64-a140-4190-86ac-252ebe1616c3 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d61e9333-fe01-4a9e-abab-ef31ba6d4173/action" status: 202 len: 0 microversion: 2.1 time: 0.763241 Apr 17 10:47:25 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 193/605] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 10:47:24 2023] POST /compute/v2.1/servers/d61e9333-fe01-4a9e-abab-ef31ba6d4173/action => generated 0 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 17 10:47:34 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-766687741", "imageRef": "fa787c35-c17b-4909-bc09-897818a6156f", "flavorRef": "42", "key_name": "tempest-TestStampPattern-12722321", "security_groups": [{"name": "tempest-secgroup-smoke-1808414415"}], "networks": [{"uuid": "01d90d12-f4b4-4119-ae59-f973d369d909"}]}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:47:34 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:47:34 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:47:34 user devstack@n-api.service[72745]: DEBUG nova.network.neutron [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] validate_networks() for [('01d90d12-f4b4-4119-ae59-f973d369d909', None, None, None, None, None)] {{(pid=72745) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:47:34 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Flavor limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:47:34 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Image limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:47:34 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Flavor pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:47:34 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Image pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:47:34 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:47:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:34 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Getting quotas for project 84cd384dfcbb4739b9694704c1fad001. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:47:34 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Getting quotas for user 708740584a3d488da0ee13e5f8299b7f and project 84cd384dfcbb4739b9694704c1fad001. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:47:34 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Going to run 1 instances... {{(pid=72745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:47:34 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa787c35-c17b-4909-bc09-897818a6156f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:47:34 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-d16c216d-2779-47af-838d-5dc671cfd641 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.660296 Apr 17 10:47:34 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 209/606] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:47:34 2023] POST /compute/v2.1/servers => generated 404 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 10:47:34 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-1be93566-e81e-42c8-a6e6-aa638b99ad79 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:47:34 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-1be93566-e81e-42c8-a6e6-aa638b99ad79 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:34 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=11 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:47:34 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=27 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:47:34 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-1be93566-e81e-42c8-a6e6-aa638b99ad79 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708740584a3d488da0ee13e5f8299b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84cd384dfcbb4739b9694704c1fad001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:47:34 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-1be93566-e81e-42c8-a6e6-aa638b99ad79 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a23c573c-7547-4739-bf72-ad8fa8fab7ed" status: 200 len: 1234 microversion: 2.1 time: 0.076570 Apr 17 10:47:34 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 205/607] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:47:34 2023] GET /compute/v2.1/servers/a23c573c-7547-4739-bf72-ad8fa8fab7ed => generated 1234 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:47:37 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=12 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:47:37 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:47:37 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-c04343a7-020a-4ac7-8c2f-f622574bd7c2 req-41c1f72b-24d8-4568-a29d-f9fb107a10ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a23c573c-7547-4739-bf72-ad8fa8fab7ed", "tag": "d676d231-6c3e-427a-83f1-caab25925cd6"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:47:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-c04343a7-020a-4ac7-8c2f-f622574bd7c2 req-41c1f72b-24d8-4568-a29d-f9fb107a10ee service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-c04343a7-020a-4ac7-8c2f-f622574bd7c2 req-41c1f72b-24d8-4568-a29d-f9fb107a10ee service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-c04343a7-020a-4ac7-8c2f-f622574bd7c2 req-41c1f72b-24d8-4568-a29d-f9fb107a10ee service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:37 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-c04343a7-020a-4ac7-8c2f-f622574bd7c2 req-41c1f72b-24d8-4568-a29d-f9fb107a10ee service nova] Creating event network-changed:d676d231-6c3e-427a-83f1-caab25925cd6 for instance a23c573c-7547-4739-bf72-ad8fa8fab7ed on user Apr 17 10:47:37 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-c04343a7-020a-4ac7-8c2f-f622574bd7c2 req-41c1f72b-24d8-4568-a29d-f9fb107a10ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039562 Apr 17 10:47:37 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 194/608] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:47:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:47:39 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-4e059673-45c7-4a5b-8841-0a63f2fa8756 req-2d7fbc60-2cb5-4c46-9556-b3c909cd2034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a23c573c-7547-4739-bf72-ad8fa8fab7ed", "name": "network-vif-plugged", "status": "completed", "tag": "d676d231-6c3e-427a-83f1-caab25925cd6"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:47:39 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-4e059673-45c7-4a5b-8841-0a63f2fa8756 req-2d7fbc60-2cb5-4c46-9556-b3c909cd2034 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:39 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-4e059673-45c7-4a5b-8841-0a63f2fa8756 req-2d7fbc60-2cb5-4c46-9556-b3c909cd2034 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:39 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-4e059673-45c7-4a5b-8841-0a63f2fa8756 req-2d7fbc60-2cb5-4c46-9556-b3c909cd2034 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:39 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-4e059673-45c7-4a5b-8841-0a63f2fa8756 req-2d7fbc60-2cb5-4c46-9556-b3c909cd2034 service nova] Creating event network-vif-plugged:d676d231-6c3e-427a-83f1-caab25925cd6 for instance a23c573c-7547-4739-bf72-ad8fa8fab7ed on user Apr 17 10:47:39 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-4e059673-45c7-4a5b-8841-0a63f2fa8756 req-2d7fbc60-2cb5-4c46-9556-b3c909cd2034 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032739 Apr 17 10:47:39 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 210/609] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:47:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:47:39 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-394c9187-786f-4a72-a7f2-f684dee001d3 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:47:39 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-394c9187-786f-4a72-a7f2-f684dee001d3 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:39 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-394c9187-786f-4a72-a7f2-f684dee001d3 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:39 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-394c9187-786f-4a72-a7f2-f684dee001d3 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:39 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-394c9187-786f-4a72-a7f2-f684dee001d3 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:39 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-394c9187-786f-4a72-a7f2-f684dee001d3 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:39 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-394c9187-786f-4a72-a7f2-f684dee001d3 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:39 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-394c9187-786f-4a72-a7f2-f684dee001d3 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:40 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-394c9187-786f-4a72-a7f2-f684dee001d3 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:47:40 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-394c9187-786f-4a72-a7f2-f684dee001d3 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:47:40 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-394c9187-786f-4a72-a7f2-f684dee001d3 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:47:40 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-394c9187-786f-4a72-a7f2-f684dee001d3 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e198ad00-927f-45e1-9f14-828d56ce3393" status: 200 len: 1769 microversion: 2.87 time: 0.235473 Apr 17 10:47:40 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 206/610] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:47:39 2023] GET /compute/v2.1/servers/e198ad00-927f-45e1-9f14-828d56ce3393 => generated 1769 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:47:41 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-157ea7e9-ed09-4c09-bbe3-c2e80514e6f4 req-a9888c45-9d65-45fb-8b39-e879abd4869e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a23c573c-7547-4739-bf72-ad8fa8fab7ed", "name": "network-vif-plugged", "status": "completed", "tag": "d676d231-6c3e-427a-83f1-caab25925cd6"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:47:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-157ea7e9-ed09-4c09-bbe3-c2e80514e6f4 req-a9888c45-9d65-45fb-8b39-e879abd4869e service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-157ea7e9-ed09-4c09-bbe3-c2e80514e6f4 req-a9888c45-9d65-45fb-8b39-e879abd4869e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-157ea7e9-ed09-4c09-bbe3-c2e80514e6f4 req-a9888c45-9d65-45fb-8b39-e879abd4869e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:41 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-157ea7e9-ed09-4c09-bbe3-c2e80514e6f4 req-a9888c45-9d65-45fb-8b39-e879abd4869e service nova] Creating event network-vif-plugged:d676d231-6c3e-427a-83f1-caab25925cd6 for instance a23c573c-7547-4739-bf72-ad8fa8fab7ed on user Apr 17 10:47:41 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-157ea7e9-ed09-4c09-bbe3-c2e80514e6f4 req-a9888c45-9d65-45fb-8b39-e879abd4869e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042917 Apr 17 10:47:41 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 195/611] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:47:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:47:41 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-c3fbb50e-c6ad-4fad-8ce6-507ff8ec6b0b tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:47:41 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-c3fbb50e-c6ad-4fad-8ce6-507ff8ec6b0b tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c3fbb50e-c6ad-4fad-8ce6-507ff8ec6b0b tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c3fbb50e-c6ad-4fad-8ce6-507ff8ec6b0b tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c3fbb50e-c6ad-4fad-8ce6-507ff8ec6b0b tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c3fbb50e-c6ad-4fad-8ce6-507ff8ec6b0b tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c3fbb50e-c6ad-4fad-8ce6-507ff8ec6b0b tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c3fbb50e-c6ad-4fad-8ce6-507ff8ec6b0b tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:41 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-c3fbb50e-c6ad-4fad-8ce6-507ff8ec6b0b tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042479 Apr 17 10:47:41 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 211/612] 10.0.0.210 () {64 vars in 1420 bytes} [Mon Apr 17 10:47:41 2023] GET /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:47:42 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:47:42 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:42 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:42 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Going to try to terminate instance {{(pid=72743) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:47:42 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-49898243-1a68-43a4-b0a6-879d345fc2a6 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b" status: 204 len: 0 microversion: 2.20 time: 0.142330 Apr 17 10:47:42 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 207/613] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 17 10:47:42 2023] DELETE /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 17 10:47:42 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-f6e57185-57e6-4221-b74f-c7871e2c0891 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:47:42 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-f6e57185-57e6-4221-b74f-c7871e2c0891 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:42 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f6e57185-57e6-4221-b74f-c7871e2c0891 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:42 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f6e57185-57e6-4221-b74f-c7871e2c0891 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:42 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f6e57185-57e6-4221-b74f-c7871e2c0891 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:42 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f6e57185-57e6-4221-b74f-c7871e2c0891 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:42 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f6e57185-57e6-4221-b74f-c7871e2c0891 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:42 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f6e57185-57e6-4221-b74f-c7871e2c0891 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:42 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-f6e57185-57e6-4221-b74f-c7871e2c0891 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:47:42 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-f6e57185-57e6-4221-b74f-c7871e2c0891 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:47:42 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-f6e57185-57e6-4221-b74f-c7871e2c0891 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aea97828312f45ffa1b7148c375a7f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6dac880f4294283ae7838bfa0edf5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:47:42 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-f6e57185-57e6-4221-b74f-c7871e2c0891 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b" status: 200 len: 1712 microversion: 2.20 time: 0.616394 Apr 17 10:47:42 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 196/614] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:47:42 2023] GET /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b => generated 1712 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:47:42 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-da927a73-0b5f-4a00-bf16-0cecc8516fc0 req-78510228-398c-4507-8096-479ea6c86450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "288bc9dc-1698-4ca9-a670-5e219c04202b", "name": "network-vif-unplugged", "status": "completed", "tag": "8541d98c-fcb7-4f1a-904c-97db8145dd29"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:47:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-da927a73-0b5f-4a00-bf16-0cecc8516fc0 req-78510228-398c-4507-8096-479ea6c86450 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-da927a73-0b5f-4a00-bf16-0cecc8516fc0 req-78510228-398c-4507-8096-479ea6c86450 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-da927a73-0b5f-4a00-bf16-0cecc8516fc0 req-78510228-398c-4507-8096-479ea6c86450 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:42 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-da927a73-0b5f-4a00-bf16-0cecc8516fc0 req-78510228-398c-4507-8096-479ea6c86450 service nova] Creating event network-vif-unplugged:8541d98c-fcb7-4f1a-904c-97db8145dd29 for instance 288bc9dc-1698-4ca9-a670-5e219c04202b on user Apr 17 10:47:42 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-da927a73-0b5f-4a00-bf16-0cecc8516fc0 req-78510228-398c-4507-8096-479ea6c86450 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049785 Apr 17 10:47:42 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 212/615] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:47:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:47:44 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-3c04e999-d200-4287-9216-bb662e1dea90 req-a557105c-f0ab-469b-8c03-01d9ec32dd5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "288bc9dc-1698-4ca9-a670-5e219c04202b", "name": "network-vif-plugged", "status": "completed", "tag": "8541d98c-fcb7-4f1a-904c-97db8145dd29"}, {"server_uuid": "288bc9dc-1698-4ca9-a670-5e219c04202b", "name": "network-vif-deleted", "tag": "8541d98c-fcb7-4f1a-904c-97db8145dd29"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:47:44 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:47:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-3c04e999-d200-4287-9216-bb662e1dea90 req-a557105c-f0ab-469b-8c03-01d9ec32dd5c service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-3c04e999-d200-4287-9216-bb662e1dea90 req-a557105c-f0ab-469b-8c03-01d9ec32dd5c service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-3c04e999-d200-4287-9216-bb662e1dea90 req-a557105c-f0ab-469b-8c03-01d9ec32dd5c service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:44 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-3c04e999-d200-4287-9216-bb662e1dea90 req-a557105c-f0ab-469b-8c03-01d9ec32dd5c service nova] Creating event network-vif-plugged:8541d98c-fcb7-4f1a-904c-97db8145dd29 for instance 288bc9dc-1698-4ca9-a670-5e219c04202b on user Apr 17 10:47:44 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-3c04e999-d200-4287-9216-bb662e1dea90 req-a557105c-f0ab-469b-8c03-01d9ec32dd5c service nova] Creating event network-vif-deleted:8541d98c-fcb7-4f1a-904c-97db8145dd29 for instance 288bc9dc-1698-4ca9-a670-5e219c04202b on user Apr 17 10:47:44 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-3c04e999-d200-4287-9216-bb662e1dea90 req-a557105c-f0ab-469b-8c03-01d9ec32dd5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.070882 Apr 17 10:47:44 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 208/616] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:47:44 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:47:51 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-ea19718a-8ed3-4651-994b-536162dfd13c tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:47:51 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-ea19718a-8ed3-4651-994b-536162dfd13c tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] [instance: 9174e76f-1f0e-431c-b190-cb857eead406] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ea19718a-8ed3-4651-994b-536162dfd13c tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ea19718a-8ed3-4651-994b-536162dfd13c tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ea19718a-8ed3-4651-994b-536162dfd13c tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ea19718a-8ed3-4651-994b-536162dfd13c tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ea19718a-8ed3-4651-994b-536162dfd13c tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ea19718a-8ed3-4651-994b-536162dfd13c tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:51 user devstack@n-api.service[72744]: INFO nova.api.openstack.wsgi [None req-ea19718a-8ed3-4651-994b-536162dfd13c tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] HTTP exception thrown: Instance 9174e76f-1f0e-431c-b190-cb857eead406 could not be found. Apr 17 10:47:51 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-ea19718a-8ed3-4651-994b-536162dfd13c tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Request method failure captured: Apr 17 10:47:51 user devstack@n-api.service[72744]: request: GET /compute/v2.1/servers/9174e76f-1f0e-431c-b190-cb857eead406 HTTP/1.1 Apr 17 10:47:51 user devstack@n-api.service[72744]: Accept: application/json Apr 17 10:47:51 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 10:47:51 user devstack@n-api.service[72744]: Connection: close Apr 17 10:47:51 user devstack@n-api.service[72744]: Content-Length: 0 Apr 17 10:47:51 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 10:47:51 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 10:47:51 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 10:47:51 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 10:47:51 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSKPyBJf2OVUMetl_wBUJBRvMDeY7t3SW0GcWIqsXxiztyOFgP-Au2u2KTaXnXALkzhlFD-j5ghH7fdrjrRNS0LZzPgDTvutwUUDlyjY8SeeB2i5P-Qa3o_ZgjNRjxHn7QYw60EGbp79RFNw_tqaJpH4w1nqP9xoqKBiRsWVZMlCz5g Apr 17 10:47:51 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 10:47:51 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 10:47:51 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 10:47:51 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 10:47:51 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 10:47:51 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 10:47:51 user devstack@n-api.service[72744]: X-Project-Id: b309bb2b37284020b81369ec89397374 Apr 17 10:47:51 user devstack@n-api.service[72744]: X-Project-Name: tempest-VolumesActionsTest-505690119 Apr 17 10:47:51 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 10:47:51 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 10:47:51 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b309bb2b37284020b81369ec89397374"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b309bb2b37284020b81369ec89397374"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b309bb2b37284020b81369ec89397374"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:47:51 user devstack@n-api.service[72744]: X-Tenant: tempest-VolumesActionsTest-505690119 Apr 17 10:47:51 user devstack@n-api.service[72744]: X-Tenant-Id: b309bb2b37284020b81369ec89397374 Apr 17 10:47:51 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-VolumesActionsTest-505690119 Apr 17 10:47:51 user devstack@n-api.service[72744]: X-User: tempest-VolumesActionsTest-505690119-project-member Apr 17 10:47:51 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 10:47:51 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 10:47:51 user devstack@n-api.service[72744]: X-User-Id: ae91492cb6f342f58e250622e2a3ac11 Apr 17 10:47:51 user devstack@n-api.service[72744]: X-User-Name: tempest-VolumesActionsTest-505690119-project-member Apr 17 10:47:51 user devstack@n-api.service[72744]: method: > Apr 17 10:47:51 user devstack@n-api.service[72744]: exception: Instance 9174e76f-1f0e-431c-b190-cb857eead406 could not be found. Apr 17 10:47:51 user devstack@n-api.service[72744]: action_args: {'id': '9174e76f-1f0e-431c-b190-cb857eead406'} Apr 17 10:47:51 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9174e76f-1f0e-431c-b190-cb857eead406 could not be found. Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9174e76f-1f0e-431c-b190-cb857eead406 could not be found. Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9174e76f-1f0e-431c-b190-cb857eead406 could not be found. Apr 17 10:47:51 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:47:51 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-ea19718a-8ed3-4651-994b-536162dfd13c tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] Returning 404 to user: Instance 9174e76f-1f0e-431c-b190-cb857eead406 could not be found. {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:47:51 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-ea19718a-8ed3-4651-994b-536162dfd13c tempest-VolumesActionsTest-505690119 tempest-VolumesActionsTest-505690119-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9174e76f-1f0e-431c-b190-cb857eead406" status: 404 len: 111 microversion: 2.1 time: 0.124114 Apr 17 10:47:51 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 197/617] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:47:51 2023] GET /compute/v2.1/servers/9174e76f-1f0e-431c-b190-cb857eead406 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:47:52 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-6e4ebf18-7a06-42d2-bb46-0f5c17bd474f tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:47:52 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-6e4ebf18-7a06-42d2-bb46-0f5c17bd474f tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:52 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:47:52 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:47:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6e4ebf18-7a06-42d2-bb46-0f5c17bd474f tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6e4ebf18-7a06-42d2-bb46-0f5c17bd474f tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6e4ebf18-7a06-42d2-bb46-0f5c17bd474f tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6e4ebf18-7a06-42d2-bb46-0f5c17bd474f tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6e4ebf18-7a06-42d2-bb46-0f5c17bd474f tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6e4ebf18-7a06-42d2-bb46-0f5c17bd474f tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:52 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-6e4ebf18-7a06-42d2-bb46-0f5c17bd474f tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] HTTP exception thrown: Instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7 could not be found. Apr 17 10:47:52 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-6e4ebf18-7a06-42d2-bb46-0f5c17bd474f tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Request method failure captured: Apr 17 10:47:52 user devstack@n-api.service[72745]: request: DELETE /compute/v2.1/servers/b0a9753b-207e-4c23-9fea-f7dc89a5edf7 HTTP/1.1 Apr 17 10:47:52 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:47:52 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:47:52 user devstack@n-api.service[72745]: Connection: close Apr 17 10:47:52 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 10:47:52 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:47:52 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:47:52 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:47:52 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:47:52 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSHHBSxJU3GfcgBo4oxop3Utq3Ux8-8rgyX-78CWsY7DpxBUrhJrx5DFmxVDOSS779NXyNEKXanmdpZXAZeKA-EO7YcmTrVyRLEcXoVn2i1Ne2ZaWSUvSM9rm-nfHcTK7GVYQQzRVOzwsgq1B2sVUsCajeEIUJ_VlPPhRLKnXmI48Yo Apr 17 10:47:52 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:47:52 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:47:52 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:47:52 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:47:52 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:47:52 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:47:52 user devstack@n-api.service[72745]: X-Project-Id: a8b831c3b6c244dda1821583a6b8cd08 Apr 17 10:47:52 user devstack@n-api.service[72745]: X-Project-Name: tempest-ServersNegativeTestJSON-812869679 Apr 17 10:47:52 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:47:52 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:47:52 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a8b831c3b6c244dda1821583a6b8cd08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a8b831c3b6c244dda1821583a6b8cd08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a8b831c3b6c244dda1821583a6b8cd08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:47:52 user devstack@n-api.service[72745]: X-Tenant: tempest-ServersNegativeTestJSON-812869679 Apr 17 10:47:52 user devstack@n-api.service[72745]: X-Tenant-Id: a8b831c3b6c244dda1821583a6b8cd08 Apr 17 10:47:52 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-ServersNegativeTestJSON-812869679 Apr 17 10:47:52 user devstack@n-api.service[72745]: X-User: tempest-ServersNegativeTestJSON-812869679-project-member Apr 17 10:47:52 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:47:52 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:47:52 user devstack@n-api.service[72745]: X-User-Id: 1e61a5e172c34636b183ef9c84b714d8 Apr 17 10:47:52 user devstack@n-api.service[72745]: X-User-Name: tempest-ServersNegativeTestJSON-812869679-project-member Apr 17 10:47:52 user devstack@n-api.service[72745]: method: > Apr 17 10:47:52 user devstack@n-api.service[72745]: exception: Instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7 could not be found. Apr 17 10:47:52 user devstack@n-api.service[72745]: action_args: {'id': 'b0a9753b-207e-4c23-9fea-f7dc89a5edf7'} Apr 17 10:47:52 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7 could not be found. Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7 could not be found. Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7 could not be found. Apr 17 10:47:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:47:52 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-6e4ebf18-7a06-42d2-bb46-0f5c17bd474f tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Returning 404 to user: Instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7 could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:47:52 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-6e4ebf18-7a06-42d2-bb46-0f5c17bd474f tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b0a9753b-207e-4c23-9fea-f7dc89a5edf7" status: 404 len: 111 microversion: 2.1 time: 0.032292 Apr 17 10:47:52 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 213/618] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:47:52 2023] DELETE /compute/v2.1/servers/b0a9753b-207e-4c23-9fea-f7dc89a5edf7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:47:52 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-53a46b43-9795-4a07-8719-fdd8348688f3 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:47:52 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-53a46b43-9795-4a07-8719-fdd8348688f3 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: b0a9753b-207e-4c23-9fea-f7dc89a5edf7] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:52 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-53a46b43-9795-4a07-8719-fdd8348688f3 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:52 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-53a46b43-9795-4a07-8719-fdd8348688f3 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:52 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-53a46b43-9795-4a07-8719-fdd8348688f3 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:52 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-53a46b43-9795-4a07-8719-fdd8348688f3 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:52 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-53a46b43-9795-4a07-8719-fdd8348688f3 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:52 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-53a46b43-9795-4a07-8719-fdd8348688f3 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:52 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-53a46b43-9795-4a07-8719-fdd8348688f3 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] HTTP exception thrown: Instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7 could not be found. Apr 17 10:47:52 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-53a46b43-9795-4a07-8719-fdd8348688f3 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Request method failure captured: Apr 17 10:47:52 user devstack@n-api.service[72743]: request: GET /compute/v2.1/servers/b0a9753b-207e-4c23-9fea-f7dc89a5edf7 HTTP/1.1 Apr 17 10:47:52 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:47:52 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:47:52 user devstack@n-api.service[72743]: Connection: close Apr 17 10:47:52 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:47:52 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:47:52 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:47:52 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:47:52 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:47:52 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSHHBSxJU3GfcgBo4oxop3Utq3Ux8-8rgyX-78CWsY7DpxBUrhJrx5DFmxVDOSS779NXyNEKXanmdpZXAZeKA-EO7YcmTrVyRLEcXoVn2i1Ne2ZaWSUvSM9rm-nfHcTK7GVYQQzRVOzwsgq1B2sVUsCajeEIUJ_VlPPhRLKnXmI48Yo Apr 17 10:47:52 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:47:52 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:47:52 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:47:52 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:47:52 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:47:52 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:47:52 user devstack@n-api.service[72743]: X-Project-Id: a8b831c3b6c244dda1821583a6b8cd08 Apr 17 10:47:52 user devstack@n-api.service[72743]: X-Project-Name: tempest-ServersNegativeTestJSON-812869679 Apr 17 10:47:52 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:47:52 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:47:52 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a8b831c3b6c244dda1821583a6b8cd08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a8b831c3b6c244dda1821583a6b8cd08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a8b831c3b6c244dda1821583a6b8cd08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:47:52 user devstack@n-api.service[72743]: X-Tenant: tempest-ServersNegativeTestJSON-812869679 Apr 17 10:47:52 user devstack@n-api.service[72743]: X-Tenant-Id: a8b831c3b6c244dda1821583a6b8cd08 Apr 17 10:47:52 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-ServersNegativeTestJSON-812869679 Apr 17 10:47:52 user devstack@n-api.service[72743]: X-User: tempest-ServersNegativeTestJSON-812869679-project-member Apr 17 10:47:52 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:47:52 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:47:52 user devstack@n-api.service[72743]: X-User-Id: 1e61a5e172c34636b183ef9c84b714d8 Apr 17 10:47:52 user devstack@n-api.service[72743]: X-User-Name: tempest-ServersNegativeTestJSON-812869679-project-member Apr 17 10:47:52 user devstack@n-api.service[72743]: method: > Apr 17 10:47:52 user devstack@n-api.service[72743]: exception: Instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7 could not be found. Apr 17 10:47:52 user devstack@n-api.service[72743]: action_args: {'id': 'b0a9753b-207e-4c23-9fea-f7dc89a5edf7'} Apr 17 10:47:52 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7 could not be found. Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7 could not be found. Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7 could not be found. Apr 17 10:47:52 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:47:52 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-53a46b43-9795-4a07-8719-fdd8348688f3 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Returning 404 to user: Instance b0a9753b-207e-4c23-9fea-f7dc89a5edf7 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:47:52 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-53a46b43-9795-4a07-8719-fdd8348688f3 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0a9753b-207e-4c23-9fea-f7dc89a5edf7" status: 404 len: 111 microversion: 2.1 time: 0.035164 Apr 17 10:47:52 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 209/619] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:47:52 2023] GET /compute/v2.1/servers/b0a9753b-207e-4c23-9fea-f7dc89a5edf7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:47:52 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:47:52 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:52 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:52 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:52 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:52 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:52 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:52 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:52 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Going to try to terminate instance {{(pid=72744) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:47:52 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-75230326-2a6e-4cda-87d6-aed271e05372 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5e03807e-942b-4155-835b-b1c86f5b80f5" status: 204 len: 0 microversion: 2.1 time: 0.120983 Apr 17 10:47:52 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 198/620] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:47:52 2023] DELETE /compute/v2.1/servers/5e03807e-942b-4155-835b-b1c86f5b80f5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:47:52 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-f69c7127-5f5d-47a0-8a55-3e11780aa7d0 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:47:52 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-f69c7127-5f5d-47a0-8a55-3e11780aa7d0 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:47:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f69c7127-5f5d-47a0-8a55-3e11780aa7d0 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f69c7127-5f5d-47a0-8a55-3e11780aa7d0 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f69c7127-5f5d-47a0-8a55-3e11780aa7d0 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f69c7127-5f5d-47a0-8a55-3e11780aa7d0 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f69c7127-5f5d-47a0-8a55-3e11780aa7d0 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f69c7127-5f5d-47a0-8a55-3e11780aa7d0 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:52 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-f69c7127-5f5d-47a0-8a55-3e11780aa7d0 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e61a5e172c34636b183ef9c84b714d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b831c3b6c244dda1821583a6b8cd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:47:52 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-f69c7127-5f5d-47a0-8a55-3e11780aa7d0 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e03807e-942b-4155-835b-b1c86f5b80f5" status: 200 len: 1500 microversion: 2.1 time: 0.264257 Apr 17 10:47:52 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 214/621] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:47:52 2023] GET /compute/v2.1/servers/5e03807e-942b-4155-835b-b1c86f5b80f5 => generated 1500 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:47:52 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-139f214b-96a8-423b-bab9-1e5eaebe81ae req-b9eee498-81c4-46ed-9a40-fd2925b4f832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e03807e-942b-4155-835b-b1c86f5b80f5", "name": "network-vif-unplugged", "status": "completed", "tag": "b7885763-79d0-44c2-bc9d-4a434792584a"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:47:52 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-139f214b-96a8-423b-bab9-1e5eaebe81ae req-b9eee498-81c4-46ed-9a40-fd2925b4f832 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:52 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-139f214b-96a8-423b-bab9-1e5eaebe81ae req-b9eee498-81c4-46ed-9a40-fd2925b4f832 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:52 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-139f214b-96a8-423b-bab9-1e5eaebe81ae req-b9eee498-81c4-46ed-9a40-fd2925b4f832 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:52 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-139f214b-96a8-423b-bab9-1e5eaebe81ae req-b9eee498-81c4-46ed-9a40-fd2925b4f832 service nova] Creating event network-vif-unplugged:b7885763-79d0-44c2-bc9d-4a434792584a for instance 5e03807e-942b-4155-835b-b1c86f5b80f5 on user Apr 17 10:47:52 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-139f214b-96a8-423b-bab9-1e5eaebe81ae req-b9eee498-81c4-46ed-9a40-fd2925b4f832 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043829 Apr 17 10:47:52 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 210/622] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:47:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:47:54 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e03807e-942b-4155-835b-b1c86f5b80f5", "name": "network-vif-plugged", "status": "completed", "tag": "b7885763-79d0-44c2-bc9d-4a434792584a"}, {"server_uuid": "5e03807e-942b-4155-835b-b1c86f5b80f5", "name": "network-vif-plugged", "status": "completed", "tag": "b7885763-79d0-44c2-bc9d-4a434792584a"}, {"server_uuid": "5e03807e-942b-4155-835b-b1c86f5b80f5", "name": "network-vif-plugged", "status": "completed", "tag": "b7885763-79d0-44c2-bc9d-4a434792584a"}, {"server_uuid": "5e03807e-942b-4155-835b-b1c86f5b80f5", "name": "network-vif-unplugged", "status": "completed", "tag": "b7885763-79d0-44c2-bc9d-4a434792584a"}, {"server_uuid": "5e03807e-942b-4155-835b-b1c86f5b80f5", "name": "network-vif-plugged", "status": "completed", "tag": "b7885763-79d0-44c2-bc9d-4a434792584a"}, {"server_uuid": "5e03807e-942b-4155-835b-b1c86f5b80f5", "name": "network-vif-deleted", "tag": "b7885763-79d0-44c2-bc9d-4a434792584a"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:47:54 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:47:54 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:47:54 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:47:54 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] Creating event network-vif-plugged:b7885763-79d0-44c2-bc9d-4a434792584a for instance 5e03807e-942b-4155-835b-b1c86f5b80f5 on user Apr 17 10:47:54 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] Creating event network-vif-plugged:b7885763-79d0-44c2-bc9d-4a434792584a for instance 5e03807e-942b-4155-835b-b1c86f5b80f5 on user Apr 17 10:47:54 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] Creating event network-vif-plugged:b7885763-79d0-44c2-bc9d-4a434792584a for instance 5e03807e-942b-4155-835b-b1c86f5b80f5 on user Apr 17 10:47:54 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] Creating event network-vif-unplugged:b7885763-79d0-44c2-bc9d-4a434792584a for instance 5e03807e-942b-4155-835b-b1c86f5b80f5 on user Apr 17 10:47:54 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] Creating event network-vif-plugged:b7885763-79d0-44c2-bc9d-4a434792584a for instance 5e03807e-942b-4155-835b-b1c86f5b80f5 on user Apr 17 10:47:54 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] Creating event network-vif-deleted:b7885763-79d0-44c2-bc9d-4a434792584a for instance 5e03807e-942b-4155-835b-b1c86f5b80f5 on user Apr 17 10:47:54 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-c3a60bf5-ca3a-4a30-99af-bab678f851c1 req-e4cff45b-a095-46fe-bfcd-19fc4c95118b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.035302 Apr 17 10:47:54 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 199/623] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:47:54 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:48:08 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-7cb2c002-492d-410e-9a13-a3b90235750e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:48:08 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-7cb2c002-492d-410e-9a13-a3b90235750e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:48:08 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:48:08 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=20 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:48:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7cb2c002-492d-410e-9a13-a3b90235750e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7cb2c002-492d-410e-9a13-a3b90235750e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7cb2c002-492d-410e-9a13-a3b90235750e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7cb2c002-492d-410e-9a13-a3b90235750e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7cb2c002-492d-410e-9a13-a3b90235750e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7cb2c002-492d-410e-9a13-a3b90235750e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:08 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-7cb2c002-492d-410e-9a13-a3b90235750e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:48:08 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-7cb2c002-492d-410e-9a13-a3b90235750e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 200 len: 1655 microversion: 2.1 time: 0.384774 Apr 17 10:48:08 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 215/624] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:48:08 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 1655 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:48:08 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:48:08 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:48:08 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-6569427a-ac96-4ea8-9fc8-3aaa7ca1fed6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:48:08 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-6569427a-ac96-4ea8-9fc8-3aaa7ca1fed6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:48:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6569427a-ac96-4ea8-9fc8-3aaa7ca1fed6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6569427a-ac96-4ea8-9fc8-3aaa7ca1fed6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6569427a-ac96-4ea8-9fc8-3aaa7ca1fed6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6569427a-ac96-4ea8-9fc8-3aaa7ca1fed6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6569427a-ac96-4ea8-9fc8-3aaa7ca1fed6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6569427a-ac96-4ea8-9fc8-3aaa7ca1fed6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:08 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-6569427a-ac96-4ea8-9fc8-3aaa7ca1fed6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:48:08 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-6569427a-ac96-4ea8-9fc8-3aaa7ca1fed6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 200 len: 1655 microversion: 2.1 time: 0.358604 Apr 17 10:48:08 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 211/625] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:48:08 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 1655 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:48:11 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:48:11 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:48:11 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-e5e528e6-5ee3-4841-b4f0-9beae429726b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:48:11 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-e5e528e6-5ee3-4841-b4f0-9beae429726b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:48:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e5e528e6-5ee3-4841-b4f0-9beae429726b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e5e528e6-5ee3-4841-b4f0-9beae429726b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e5e528e6-5ee3-4841-b4f0-9beae429726b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e5e528e6-5ee3-4841-b4f0-9beae429726b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e5e528e6-5ee3-4841-b4f0-9beae429726b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e5e528e6-5ee3-4841-b4f0-9beae429726b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.wsgi [None req-e5e528e6-5ee3-4841-b4f0-9beae429726b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] HTTP exception thrown: Instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 could not be found. Apr 17 10:48:11 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-e5e528e6-5ee3-4841-b4f0-9beae429726b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Request method failure captured: Apr 17 10:48:11 user devstack@n-api.service[72744]: request: GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3 HTTP/1.1 Apr 17 10:48:11 user devstack@n-api.service[72744]: Accept: application/json Apr 17 10:48:11 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 10:48:11 user devstack@n-api.service[72744]: Connection: close Apr 17 10:48:11 user devstack@n-api.service[72744]: Content-Length: 0 Apr 17 10:48:11 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 10:48:11 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 10:48:11 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 10:48:11 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 10:48:11 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSCx2mb0bnvW5f2FJF2zY_X_OlIm3UEDUrC5-WRcj212HlWfKNe_D1jZqhVBMyegk-7_jZ95qzICGeXGUe_o7C-yIFpFVR3Eks3B7sJZC95tfHDVwBr_gefHHa_4-d9PUEMfLmCptg0OsFGeKfV1Fos6DUIkOUTmnRBrYWKo1kq4h8o Apr 17 10:48:11 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 10:48:11 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 10:48:11 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 10:48:11 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 10:48:11 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 10:48:11 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 10:48:11 user devstack@n-api.service[72744]: X-Project-Id: 6a17ec3e1b314acbb701f2d2d27d0560 Apr 17 10:48:11 user devstack@n-api.service[72744]: X-Project-Name: tempest-AttachVolumeTestJSON-2096000567 Apr 17 10:48:11 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 10:48:11 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 10:48:11 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a17ec3e1b314acbb701f2d2d27d0560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a17ec3e1b314acbb701f2d2d27d0560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6a17ec3e1b314acbb701f2d2d27d0560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:48:11 user devstack@n-api.service[72744]: X-Tenant: tempest-AttachVolumeTestJSON-2096000567 Apr 17 10:48:11 user devstack@n-api.service[72744]: X-Tenant-Id: 6a17ec3e1b314acbb701f2d2d27d0560 Apr 17 10:48:11 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2096000567 Apr 17 10:48:11 user devstack@n-api.service[72744]: X-User: tempest-AttachVolumeTestJSON-2096000567-project-member Apr 17 10:48:11 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 10:48:11 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 10:48:11 user devstack@n-api.service[72744]: X-User-Id: a9862432f87f4500a46f32a0b27d54d4 Apr 17 10:48:11 user devstack@n-api.service[72744]: X-User-Name: tempest-AttachVolumeTestJSON-2096000567-project-member Apr 17 10:48:11 user devstack@n-api.service[72744]: method: > Apr 17 10:48:11 user devstack@n-api.service[72744]: exception: Instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 could not be found. Apr 17 10:48:11 user devstack@n-api.service[72744]: action_args: {'id': '44e80daa-73f1-4b84-8cbc-3dd0ea159da3'} Apr 17 10:48:11 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 could not be found. Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 could not be found. Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 could not be found. Apr 17 10:48:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:48:11 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-e5e528e6-5ee3-4841-b4f0-9beae429726b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Returning 404 to user: Instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 could not be found. {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:48:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-e5e528e6-5ee3-4841-b4f0-9beae429726b tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3" status: 404 len: 111 microversion: 2.1 time: 0.052760 Apr 17 10:48:11 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 200/626] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:48:11 2023] GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:48:11 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-bae1a59e-ef14-4027-b442-7e0e9b2b8108 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '.version_select at 0x7fc55a8928c0>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:48:11 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-bae1a59e-ef14-4027-b442-7e0e9b2b8108 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-126931336" status: 202 len: 0 microversion: 2.1 time: 0.020623 Apr 17 10:48:11 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 216/627] 10.0.0.210 () {62 vars in 1295 bytes} [Mon Apr 17 10:48:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-126931336 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 17 10:48:19 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b0772317-5ece-47c4-8783-7c5f31a3cb02 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:48:19 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-b0772317-5ece-47c4-8783-7c5f31a3cb02 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:48:19 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:48:19 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:48:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b0772317-5ece-47c4-8783-7c5f31a3cb02 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b0772317-5ece-47c4-8783-7c5f31a3cb02 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b0772317-5ece-47c4-8783-7c5f31a3cb02 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b0772317-5ece-47c4-8783-7c5f31a3cb02 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b0772317-5ece-47c4-8783-7c5f31a3cb02 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b0772317-5ece-47c4-8783-7c5f31a3cb02 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:19 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-b0772317-5ece-47c4-8783-7c5f31a3cb02 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] HTTP exception thrown: Instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 could not be found. Apr 17 10:48:19 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b0772317-5ece-47c4-8783-7c5f31a3cb02 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Request method failure captured: Apr 17 10:48:19 user devstack@n-api.service[72743]: request: DELETE /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3 HTTP/1.1 Apr 17 10:48:19 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:48:19 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:48:19 user devstack@n-api.service[72743]: Connection: close Apr 17 10:48:19 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:48:19 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:48:19 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:48:19 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:48:19 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:48:19 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSCx2mb0bnvW5f2FJF2zY_X_OlIm3UEDUrC5-WRcj212HlWfKNe_D1jZqhVBMyegk-7_jZ95qzICGeXGUe_o7C-yIFpFVR3Eks3B7sJZC95tfHDVwBr_gefHHa_4-d9PUEMfLmCptg0OsFGeKfV1Fos6DUIkOUTmnRBrYWKo1kq4h8o Apr 17 10:48:19 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:48:19 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:48:19 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:48:19 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:48:19 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:48:19 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:48:19 user devstack@n-api.service[72743]: X-Project-Id: 6a17ec3e1b314acbb701f2d2d27d0560 Apr 17 10:48:19 user devstack@n-api.service[72743]: X-Project-Name: tempest-AttachVolumeTestJSON-2096000567 Apr 17 10:48:19 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:48:19 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:48:19 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a17ec3e1b314acbb701f2d2d27d0560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a17ec3e1b314acbb701f2d2d27d0560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6a17ec3e1b314acbb701f2d2d27d0560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:48:19 user devstack@n-api.service[72743]: X-Tenant: tempest-AttachVolumeTestJSON-2096000567 Apr 17 10:48:19 user devstack@n-api.service[72743]: X-Tenant-Id: 6a17ec3e1b314acbb701f2d2d27d0560 Apr 17 10:48:19 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2096000567 Apr 17 10:48:19 user devstack@n-api.service[72743]: X-User: tempest-AttachVolumeTestJSON-2096000567-project-member Apr 17 10:48:19 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:48:19 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:48:19 user devstack@n-api.service[72743]: X-User-Id: a9862432f87f4500a46f32a0b27d54d4 Apr 17 10:48:19 user devstack@n-api.service[72743]: X-User-Name: tempest-AttachVolumeTestJSON-2096000567-project-member Apr 17 10:48:19 user devstack@n-api.service[72743]: method: > Apr 17 10:48:19 user devstack@n-api.service[72743]: exception: Instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 could not be found. Apr 17 10:48:19 user devstack@n-api.service[72743]: action_args: {'id': '44e80daa-73f1-4b84-8cbc-3dd0ea159da3'} Apr 17 10:48:19 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 could not be found. Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 could not be found. Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 could not be found. Apr 17 10:48:19 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:48:19 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b0772317-5ece-47c4-8783-7c5f31a3cb02 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Returning 404 to user: Instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:48:19 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-b0772317-5ece-47c4-8783-7c5f31a3cb02 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3" status: 404 len: 111 microversion: 2.1 time: 0.053294 Apr 17 10:48:19 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 212/628] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:48:19 2023] DELETE /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:48:19 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-34cfd093-7e42-4995-a1a9-52999ff402ad tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:48:19 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-34cfd093-7e42-4995-a1a9-52999ff402ad tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 44e80daa-73f1-4b84-8cbc-3dd0ea159da3] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:48:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-34cfd093-7e42-4995-a1a9-52999ff402ad tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-34cfd093-7e42-4995-a1a9-52999ff402ad tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-34cfd093-7e42-4995-a1a9-52999ff402ad tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-34cfd093-7e42-4995-a1a9-52999ff402ad tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-34cfd093-7e42-4995-a1a9-52999ff402ad tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-34cfd093-7e42-4995-a1a9-52999ff402ad tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:19 user devstack@n-api.service[72744]: INFO nova.api.openstack.wsgi [None req-34cfd093-7e42-4995-a1a9-52999ff402ad tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] HTTP exception thrown: Instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 could not be found. Apr 17 10:48:19 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-34cfd093-7e42-4995-a1a9-52999ff402ad tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Request method failure captured: Apr 17 10:48:19 user devstack@n-api.service[72744]: request: GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3 HTTP/1.1 Apr 17 10:48:19 user devstack@n-api.service[72744]: Accept: application/json Apr 17 10:48:19 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 10:48:19 user devstack@n-api.service[72744]: Connection: close Apr 17 10:48:19 user devstack@n-api.service[72744]: Content-Length: 0 Apr 17 10:48:19 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 10:48:19 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 10:48:19 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 10:48:19 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 10:48:19 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSCx2mb0bnvW5f2FJF2zY_X_OlIm3UEDUrC5-WRcj212HlWfKNe_D1jZqhVBMyegk-7_jZ95qzICGeXGUe_o7C-yIFpFVR3Eks3B7sJZC95tfHDVwBr_gefHHa_4-d9PUEMfLmCptg0OsFGeKfV1Fos6DUIkOUTmnRBrYWKo1kq4h8o Apr 17 10:48:19 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 10:48:19 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 10:48:19 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 10:48:19 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 10:48:19 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 10:48:19 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 10:48:19 user devstack@n-api.service[72744]: X-Project-Id: 6a17ec3e1b314acbb701f2d2d27d0560 Apr 17 10:48:19 user devstack@n-api.service[72744]: X-Project-Name: tempest-AttachVolumeTestJSON-2096000567 Apr 17 10:48:19 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 10:48:19 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 10:48:19 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a17ec3e1b314acbb701f2d2d27d0560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a17ec3e1b314acbb701f2d2d27d0560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6a17ec3e1b314acbb701f2d2d27d0560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:48:19 user devstack@n-api.service[72744]: X-Tenant: tempest-AttachVolumeTestJSON-2096000567 Apr 17 10:48:19 user devstack@n-api.service[72744]: X-Tenant-Id: 6a17ec3e1b314acbb701f2d2d27d0560 Apr 17 10:48:19 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2096000567 Apr 17 10:48:19 user devstack@n-api.service[72744]: X-User: tempest-AttachVolumeTestJSON-2096000567-project-member Apr 17 10:48:19 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 10:48:19 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 10:48:19 user devstack@n-api.service[72744]: X-User-Id: a9862432f87f4500a46f32a0b27d54d4 Apr 17 10:48:19 user devstack@n-api.service[72744]: X-User-Name: tempest-AttachVolumeTestJSON-2096000567-project-member Apr 17 10:48:19 user devstack@n-api.service[72744]: method: > Apr 17 10:48:19 user devstack@n-api.service[72744]: exception: Instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 could not be found. Apr 17 10:48:19 user devstack@n-api.service[72744]: action_args: {'id': '44e80daa-73f1-4b84-8cbc-3dd0ea159da3'} Apr 17 10:48:19 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 could not be found. Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 could not be found. Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 could not be found. Apr 17 10:48:19 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:48:19 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-34cfd093-7e42-4995-a1a9-52999ff402ad tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Returning 404 to user: Instance 44e80daa-73f1-4b84-8cbc-3dd0ea159da3 could not be found. {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:48:19 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-34cfd093-7e42-4995-a1a9-52999ff402ad tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3" status: 404 len: 111 microversion: 2.1 time: 0.028308 Apr 17 10:48:19 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 201/629] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:48:19 2023] GET /compute/v2.1/servers/44e80daa-73f1-4b84-8cbc-3dd0ea159da3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:48:23 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:48:23 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:48:23 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-afccbda5-3355-4e9d-9ac0-019140a91305 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:48:23 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-afccbda5-3355-4e9d-9ac0-019140a91305 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:48:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-afccbda5-3355-4e9d-9ac0-019140a91305 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-afccbda5-3355-4e9d-9ac0-019140a91305 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-afccbda5-3355-4e9d-9ac0-019140a91305 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-afccbda5-3355-4e9d-9ac0-019140a91305 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-afccbda5-3355-4e9d-9ac0-019140a91305 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-afccbda5-3355-4e9d-9ac0-019140a91305 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:23 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-afccbda5-3355-4e9d-9ac0-019140a91305 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] HTTP exception thrown: Instance 59fd26de-d46e-4f41-91f6-090005a07d99 could not be found. Apr 17 10:48:23 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-afccbda5-3355-4e9d-9ac0-019140a91305 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Request method failure captured: Apr 17 10:48:23 user devstack@n-api.service[72745]: request: DELETE /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99 HTTP/1.1 Apr 17 10:48:23 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:48:23 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:48:23 user devstack@n-api.service[72745]: Connection: close Apr 17 10:48:23 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 10:48:23 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:48:23 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:48:23 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:48:23 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:48:23 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSCx2mb0bnvW5f2FJF2zY_X_OlIm3UEDUrC5-WRcj212HlWfKNe_D1jZqhVBMyegk-7_jZ95qzICGeXGUe_o7C-yIFpFVR3Eks3B7sJZC95tfHDVwBr_gefHHa_4-d9PUEMfLmCptg0OsFGeKfV1Fos6DUIkOUTmnRBrYWKo1kq4h8o Apr 17 10:48:23 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:48:23 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:48:23 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:48:23 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:48:23 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:48:23 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:48:23 user devstack@n-api.service[72745]: X-Project-Id: 6a17ec3e1b314acbb701f2d2d27d0560 Apr 17 10:48:23 user devstack@n-api.service[72745]: X-Project-Name: tempest-AttachVolumeTestJSON-2096000567 Apr 17 10:48:23 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:48:23 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:48:23 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a17ec3e1b314acbb701f2d2d27d0560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a17ec3e1b314acbb701f2d2d27d0560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6a17ec3e1b314acbb701f2d2d27d0560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:48:23 user devstack@n-api.service[72745]: X-Tenant: tempest-AttachVolumeTestJSON-2096000567 Apr 17 10:48:23 user devstack@n-api.service[72745]: X-Tenant-Id: 6a17ec3e1b314acbb701f2d2d27d0560 Apr 17 10:48:23 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2096000567 Apr 17 10:48:23 user devstack@n-api.service[72745]: X-User: tempest-AttachVolumeTestJSON-2096000567-project-member Apr 17 10:48:23 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:48:23 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:48:23 user devstack@n-api.service[72745]: X-User-Id: a9862432f87f4500a46f32a0b27d54d4 Apr 17 10:48:23 user devstack@n-api.service[72745]: X-User-Name: tempest-AttachVolumeTestJSON-2096000567-project-member Apr 17 10:48:23 user devstack@n-api.service[72745]: method: > Apr 17 10:48:23 user devstack@n-api.service[72745]: exception: Instance 59fd26de-d46e-4f41-91f6-090005a07d99 could not be found. Apr 17 10:48:23 user devstack@n-api.service[72745]: action_args: {'id': '59fd26de-d46e-4f41-91f6-090005a07d99'} Apr 17 10:48:23 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59fd26de-d46e-4f41-91f6-090005a07d99 could not be found. Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59fd26de-d46e-4f41-91f6-090005a07d99 could not be found. Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59fd26de-d46e-4f41-91f6-090005a07d99 could not be found. Apr 17 10:48:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:48:23 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-afccbda5-3355-4e9d-9ac0-019140a91305 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Returning 404 to user: Instance 59fd26de-d46e-4f41-91f6-090005a07d99 could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:48:23 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-afccbda5-3355-4e9d-9ac0-019140a91305 tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99" status: 404 len: 111 microversion: 2.1 time: 0.033494 Apr 17 10:48:23 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 217/630] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:48:23 2023] DELETE /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:48:23 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-a39b2318-fe3d-4d8b-a985-4c2f84c91dab tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:48:23 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-a39b2318-fe3d-4d8b-a985-4c2f84c91dab tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] [instance: 59fd26de-d46e-4f41-91f6-090005a07d99] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:48:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a39b2318-fe3d-4d8b-a985-4c2f84c91dab tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a39b2318-fe3d-4d8b-a985-4c2f84c91dab tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a39b2318-fe3d-4d8b-a985-4c2f84c91dab tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a39b2318-fe3d-4d8b-a985-4c2f84c91dab tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a39b2318-fe3d-4d8b-a985-4c2f84c91dab tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a39b2318-fe3d-4d8b-a985-4c2f84c91dab tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:23 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-a39b2318-fe3d-4d8b-a985-4c2f84c91dab tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] HTTP exception thrown: Instance 59fd26de-d46e-4f41-91f6-090005a07d99 could not be found. Apr 17 10:48:23 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-a39b2318-fe3d-4d8b-a985-4c2f84c91dab tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Request method failure captured: Apr 17 10:48:23 user devstack@n-api.service[72743]: request: GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99 HTTP/1.1 Apr 17 10:48:23 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:48:23 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:48:23 user devstack@n-api.service[72743]: Connection: close Apr 17 10:48:23 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:48:23 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:48:23 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:48:23 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:48:23 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:48:23 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSCx2mb0bnvW5f2FJF2zY_X_OlIm3UEDUrC5-WRcj212HlWfKNe_D1jZqhVBMyegk-7_jZ95qzICGeXGUe_o7C-yIFpFVR3Eks3B7sJZC95tfHDVwBr_gefHHa_4-d9PUEMfLmCptg0OsFGeKfV1Fos6DUIkOUTmnRBrYWKo1kq4h8o Apr 17 10:48:23 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:48:23 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:48:23 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:48:23 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:48:23 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:48:23 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:48:23 user devstack@n-api.service[72743]: X-Project-Id: 6a17ec3e1b314acbb701f2d2d27d0560 Apr 17 10:48:23 user devstack@n-api.service[72743]: X-Project-Name: tempest-AttachVolumeTestJSON-2096000567 Apr 17 10:48:23 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:48:23 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:48:23 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a17ec3e1b314acbb701f2d2d27d0560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a17ec3e1b314acbb701f2d2d27d0560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6a17ec3e1b314acbb701f2d2d27d0560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:48:23 user devstack@n-api.service[72743]: X-Tenant: tempest-AttachVolumeTestJSON-2096000567 Apr 17 10:48:23 user devstack@n-api.service[72743]: X-Tenant-Id: 6a17ec3e1b314acbb701f2d2d27d0560 Apr 17 10:48:23 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2096000567 Apr 17 10:48:23 user devstack@n-api.service[72743]: X-User: tempest-AttachVolumeTestJSON-2096000567-project-member Apr 17 10:48:23 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:48:23 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:48:23 user devstack@n-api.service[72743]: X-User-Id: a9862432f87f4500a46f32a0b27d54d4 Apr 17 10:48:23 user devstack@n-api.service[72743]: X-User-Name: tempest-AttachVolumeTestJSON-2096000567-project-member Apr 17 10:48:23 user devstack@n-api.service[72743]: method: > Apr 17 10:48:23 user devstack@n-api.service[72743]: exception: Instance 59fd26de-d46e-4f41-91f6-090005a07d99 could not be found. Apr 17 10:48:23 user devstack@n-api.service[72743]: action_args: {'id': '59fd26de-d46e-4f41-91f6-090005a07d99'} Apr 17 10:48:23 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59fd26de-d46e-4f41-91f6-090005a07d99 could not be found. Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59fd26de-d46e-4f41-91f6-090005a07d99 could not be found. Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59fd26de-d46e-4f41-91f6-090005a07d99 could not be found. Apr 17 10:48:23 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:48:23 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-a39b2318-fe3d-4d8b-a985-4c2f84c91dab tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] Returning 404 to user: Instance 59fd26de-d46e-4f41-91f6-090005a07d99 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:48:23 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-a39b2318-fe3d-4d8b-a985-4c2f84c91dab tempest-AttachVolumeTestJSON-2096000567 tempest-AttachVolumeTestJSON-2096000567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99" status: 404 len: 111 microversion: 2.1 time: 0.026215 Apr 17 10:48:23 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 213/631] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:48:23 2023] GET /compute/v2.1/servers/59fd26de-d46e-4f41-91f6-090005a07d99 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 17 10:48:24 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-03dd667a-e2a5-4aa4-8d08-c005232ed04e tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:48:24 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-03dd667a-e2a5-4aa4-8d08-c005232ed04e tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:48:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-03dd667a-e2a5-4aa4-8d08-c005232ed04e tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-03dd667a-e2a5-4aa4-8d08-c005232ed04e tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-03dd667a-e2a5-4aa4-8d08-c005232ed04e tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-03dd667a-e2a5-4aa4-8d08-c005232ed04e tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-03dd667a-e2a5-4aa4-8d08-c005232ed04e tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-03dd667a-e2a5-4aa4-8d08-c005232ed04e tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:25 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-03dd667a-e2a5-4aa4-8d08-c005232ed04e tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708740584a3d488da0ee13e5f8299b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84cd384dfcbb4739b9694704c1fad001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:48:25 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-03dd667a-e2a5-4aa4-8d08-c005232ed04e tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a23c573c-7547-4739-bf72-ad8fa8fab7ed" status: 200 len: 1534 microversion: 2.1 time: 0.732974 Apr 17 10:48:25 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 202/632] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:48:24 2023] GET /compute/v2.1/servers/a23c573c-7547-4739-bf72-ad8fa8fab7ed => generated 1534 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:48:27 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-b09fa1b4-af28-4692-ad89-08b9355b517c tempest-VolumesGetTestJSON-871106965 tempest-VolumesGetTestJSON-871106965-project-member] Action: 'create', calling method: .version_select at 0x7fc55a9ceb90>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-715076793", "metadata": {"Type": "work"}}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:48:28 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-b09fa1b4-af28-4692-ad89-08b9355b517c tempest-VolumesGetTestJSON-871106965 tempest-VolumesGetTestJSON-871106965-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.519174 Apr 17 10:48:28 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 218/633] 10.0.0.210 () {64 vars in 1233 bytes} [Mon Apr 17 10:48:27 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 520 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 17 10:48:28 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-6edc80bd-80fa-4dbd-87dd-4317ec9e65bd tempest-VolumesGetTestJSON-871106965 tempest-VolumesGetTestJSON-871106965-project-member] Calling method '.version_select at 0x7fc55a869f30>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:48:28 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-6edc80bd-80fa-4dbd-87dd-4317ec9e65bd tempest-VolumesGetTestJSON-871106965 tempest-VolumesGetTestJSON-871106965-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ce290acf-9173-44d9-a149-13b5b8faf41f" status: 200 len: 352 microversion: 2.1 time: 0.053358 Apr 17 10:48:28 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 214/634] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 10:48:28 2023] GET /compute/v2.1/os-volumes/ce290acf-9173-44d9-a149-13b5b8faf41f => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:48:29 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-a2371c00-c6dc-4fb9-ba1e-17f0ee1e0cb3 tempest-VolumesGetTestJSON-871106965 tempest-VolumesGetTestJSON-871106965-project-member] Calling method '.version_select at 0x7fc55a82cee0>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:48:29 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-a2371c00-c6dc-4fb9-ba1e-17f0ee1e0cb3 tempest-VolumesGetTestJSON-871106965 tempest-VolumesGetTestJSON-871106965-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ce290acf-9173-44d9-a149-13b5b8faf41f" status: 200 len: 352 microversion: 2.1 time: 0.061115 Apr 17 10:48:29 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 203/635] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 10:48:29 2023] GET /compute/v2.1/os-volumes/ce290acf-9173-44d9-a149-13b5b8faf41f => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:48:30 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-875c1f75-a16f-4afb-be4e-a6e60b62bbd2 tempest-VolumesGetTestJSON-871106965 tempest-VolumesGetTestJSON-871106965-project-member] Calling method '.version_select at 0x7fc55a7b5cf0>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:48:30 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-875c1f75-a16f-4afb-be4e-a6e60b62bbd2 tempest-VolumesGetTestJSON-871106965 tempest-VolumesGetTestJSON-871106965-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ce290acf-9173-44d9-a149-13b5b8faf41f" status: 200 len: 353 microversion: 2.1 time: 0.068529 Apr 17 10:48:30 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 219/636] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 10:48:30 2023] GET /compute/v2.1/os-volumes/ce290acf-9173-44d9-a149-13b5b8faf41f => generated 353 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:48:30 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-cec79215-ea7b-4770-a4bb-860ff4395a0f tempest-VolumesGetTestJSON-871106965 tempest-VolumesGetTestJSON-871106965-project-member] Calling method '.version_select at 0x7fc55a7280d0>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:48:30 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-cec79215-ea7b-4770-a4bb-860ff4395a0f tempest-VolumesGetTestJSON-871106965 tempest-VolumesGetTestJSON-871106965-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ce290acf-9173-44d9-a149-13b5b8faf41f" status: 200 len: 353 microversion: 2.1 time: 0.053207 Apr 17 10:48:30 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 215/637] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 10:48:30 2023] GET /compute/v2.1/os-volumes/ce290acf-9173-44d9-a149-13b5b8faf41f => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:48:30 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-e33996a6-4d11-402a-a569-a7d1c4812b4b tempest-VolumesGetTestJSON-871106965 tempest-VolumesGetTestJSON-871106965-project-member] Calling method '.version_select at 0x7fc55a8ac670>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:48:30 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-e33996a6-4d11-402a-a569-a7d1c4812b4b tempest-VolumesGetTestJSON-871106965 tempest-VolumesGetTestJSON-871106965-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/ce290acf-9173-44d9-a149-13b5b8faf41f" status: 202 len: 0 microversion: 2.1 time: 0.089159 Apr 17 10:48:30 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 204/638] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 17 10:48:30 2023] DELETE /compute/v2.1/os-volumes/ce290acf-9173-44d9-a149-13b5b8faf41f => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:48:30 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-1105d645-3804-4b2e-9a39-076690779bfc tempest-VolumesGetTestJSON-871106965 tempest-VolumesGetTestJSON-871106965-project-member] Calling method '.version_select at 0x7fc55a9cf1c0>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:48:30 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-1105d645-3804-4b2e-9a39-076690779bfc tempest-VolumesGetTestJSON-871106965 tempest-VolumesGetTestJSON-871106965-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ce290acf-9173-44d9-a149-13b5b8faf41f" status: 200 len: 352 microversion: 2.1 time: 0.051435 Apr 17 10:48:30 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 220/639] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 10:48:30 2023] GET /compute/v2.1/os-volumes/ce290acf-9173-44d9-a149-13b5b8faf41f => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:48:31 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-91ee1c40-63fd-4540-8916-7bdc9a2ed80b tempest-VolumesGetTestJSON-871106965 tempest-VolumesGetTestJSON-871106965-project-member] Calling method '.version_select at 0x7fc55a869bd0>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:48:31 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-91ee1c40-63fd-4540-8916-7bdc9a2ed80b tempest-VolumesGetTestJSON-871106965 tempest-VolumesGetTestJSON-871106965-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ce290acf-9173-44d9-a149-13b5b8faf41f" status: 200 len: 352 microversion: 2.1 time: 0.049686 Apr 17 10:48:31 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 216/640] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 10:48:31 2023] GET /compute/v2.1/os-volumes/ce290acf-9173-44d9-a149-13b5b8faf41f => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:48:32 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-8a4b6ec3-0bc6-4f54-86b0-5f07491ba355 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:48:32 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-cc89e535-fe2a-4268-8ece-75661faeefc7 tempest-VolumesGetTestJSON-871106965 tempest-VolumesGetTestJSON-871106965-project-member] Calling method '.version_select at 0x7fc55a9cc310>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:48:32 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-8a4b6ec3-0bc6-4f54-86b0-5f07491ba355 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:48:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8a4b6ec3-0bc6-4f54-86b0-5f07491ba355 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8a4b6ec3-0bc6-4f54-86b0-5f07491ba355 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8a4b6ec3-0bc6-4f54-86b0-5f07491ba355 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8a4b6ec3-0bc6-4f54-86b0-5f07491ba355 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8a4b6ec3-0bc6-4f54-86b0-5f07491ba355 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8a4b6ec3-0bc6-4f54-86b0-5f07491ba355 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:32 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-8a4b6ec3-0bc6-4f54-86b0-5f07491ba355 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] HTTP exception thrown: Instance 288bc9dc-1698-4ca9-a670-5e219c04202b could not be found. Apr 17 10:48:32 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-8a4b6ec3-0bc6-4f54-86b0-5f07491ba355 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Request method failure captured: Apr 17 10:48:32 user devstack@n-api.service[72745]: request: GET /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b HTTP/1.1 Apr 17 10:48:32 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:48:32 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:48:32 user devstack@n-api.service[72745]: Connection: close Apr 17 10:48:32 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 10:48:32 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:48:32 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:48:32 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:48:32 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:48:32 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSC2U-PxTQNibFyn7A1yYJQ2OCxZjHmsnus6b0TVvFwoNVfsvv_nH14Ltyw4E8iMU6H2pZSlRL1UjLHUBMAXKWV-535N62tbhRrfE7gt2YL3MZzPrHSr9gwyC4tQ9ETt_SC51dCtR_N06y5qW_TL_VKyh7CJY12TnLzcy4JxJHpHIlM Apr 17 10:48:32 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:48:32 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:48:32 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:48:32 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:48:32 user devstack@n-api.service[72745]: X-Openstack-Nova-Api-Version: 2.20 Apr 17 10:48:32 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:48:32 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:48:32 user devstack@n-api.service[72745]: X-Project-Id: e6dac880f4294283ae7838bfa0edf5c1 Apr 17 10:48:32 user devstack@n-api.service[72745]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1174346715 Apr 17 10:48:32 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:48:32 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:48:32 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6dac880f4294283ae7838bfa0edf5c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6dac880f4294283ae7838bfa0edf5c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e6dac880f4294283ae7838bfa0edf5c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:48:32 user devstack@n-api.service[72745]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1174346715 Apr 17 10:48:32 user devstack@n-api.service[72745]: X-Tenant-Id: e6dac880f4294283ae7838bfa0edf5c1 Apr 17 10:48:32 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1174346715 Apr 17 10:48:32 user devstack@n-api.service[72745]: X-User: tempest-AttachVolumeShelveTestJSON-1174346715-project-member Apr 17 10:48:32 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:48:32 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:48:32 user devstack@n-api.service[72745]: X-User-Id: aea97828312f45ffa1b7148c375a7f9a Apr 17 10:48:32 user devstack@n-api.service[72745]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1174346715-project-member Apr 17 10:48:32 user devstack@n-api.service[72745]: method: > Apr 17 10:48:32 user devstack@n-api.service[72745]: exception: Instance 288bc9dc-1698-4ca9-a670-5e219c04202b could not be found. Apr 17 10:48:32 user devstack@n-api.service[72745]: action_args: {'id': '288bc9dc-1698-4ca9-a670-5e219c04202b'} Apr 17 10:48:32 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 288bc9dc-1698-4ca9-a670-5e219c04202b could not be found. Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 288bc9dc-1698-4ca9-a670-5e219c04202b could not be found. Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 288bc9dc-1698-4ca9-a670-5e219c04202b could not be found. Apr 17 10:48:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:48:32 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-8a4b6ec3-0bc6-4f54-86b0-5f07491ba355 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Returning 404 to user: Instance 288bc9dc-1698-4ca9-a670-5e219c04202b could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:48:32 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-8a4b6ec3-0bc6-4f54-86b0-5f07491ba355 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b" status: 404 len: 111 microversion: 2.20 time: 0.080200 Apr 17 10:48:32 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 221/641] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:48:32 2023] GET /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 10:48:32 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-e427bb65-5972-4fd7-8134-765fd0dd7c56 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '.version_select at 0x7fc55a86beb0>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:48:32 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-e427bb65-5972-4fd7-8134-765fd0dd7c56 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1963349943" status: 204 len: 0 microversion: 2.20 time: 0.024713 Apr 17 10:48:32 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 217/642] 10.0.0.210 () {64 vars in 1339 bytes} [Mon Apr 17 10:48:32 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1963349943 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 17 10:48:32 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-cc89e535-fe2a-4268-8ece-75661faeefc7 tempest-VolumesGetTestJSON-871106965 tempest-VolumesGetTestJSON-871106965-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ce290acf-9173-44d9-a149-13b5b8faf41f" status: 200 len: 352 microversion: 2.1 time: 0.121407 Apr 17 10:48:32 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 205/643] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 10:48:32 2023] GET /compute/v2.1/os-volumes/ce290acf-9173-44d9-a149-13b5b8faf41f => generated 352 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:48:33 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-d49b90bb-2950-43e9-a42e-7e8655a9ead2 tempest-VolumesGetTestJSON-871106965 tempest-VolumesGetTestJSON-871106965-project-member] Calling method '.version_select at 0x7fc55a890820>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:48:33 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-d49b90bb-2950-43e9-a42e-7e8655a9ead2 tempest-VolumesGetTestJSON-871106965 tempest-VolumesGetTestJSON-871106965-project-member] HTTP exception thrown: Volume ce290acf-9173-44d9-a149-13b5b8faf41f could not be found. Apr 17 10:48:33 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-d49b90bb-2950-43e9-a42e-7e8655a9ead2 tempest-VolumesGetTestJSON-871106965 tempest-VolumesGetTestJSON-871106965-project-member] Request method failure captured: Apr 17 10:48:33 user devstack@n-api.service[72745]: request: GET /compute/v2.1/os-volumes/ce290acf-9173-44d9-a149-13b5b8faf41f HTTP/1.1 Apr 17 10:48:33 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:48:33 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:48:33 user devstack@n-api.service[72745]: Connection: close Apr 17 10:48:33 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 10:48:33 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:48:33 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:48:33 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:48:33 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:48:33 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSP7MimujXxD4GlNyJpGi9tpYjAgydAzmKgTbSwVx8jjw1AIA1Egq5m7lK0_FbDAwO2hm2wlAnvL4C2DKmcQ5jdzo6PYXNkyQ7BfwzmRfn6tmdnCGxYQrFJOQAuHlpaAPPATHbjz6Dho-u-IGdNXNkh-T2cbEYBi1hCaDOo67LXzk04 Apr 17 10:48:33 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:48:33 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:48:33 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:48:33 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:48:33 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:48:33 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:48:33 user devstack@n-api.service[72745]: X-Project-Id: 0f9f46e318ac44e5b9672dea2abf3ca1 Apr 17 10:48:33 user devstack@n-api.service[72745]: X-Project-Name: tempest-VolumesGetTestJSON-871106965 Apr 17 10:48:33 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:48:33 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:48:33 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f9f46e318ac44e5b9672dea2abf3ca1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f9f46e318ac44e5b9672dea2abf3ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0f9f46e318ac44e5b9672dea2abf3ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:48:33 user devstack@n-api.service[72745]: X-Tenant: tempest-VolumesGetTestJSON-871106965 Apr 17 10:48:33 user devstack@n-api.service[72745]: X-Tenant-Id: 0f9f46e318ac44e5b9672dea2abf3ca1 Apr 17 10:48:33 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-VolumesGetTestJSON-871106965 Apr 17 10:48:33 user devstack@n-api.service[72745]: X-User: tempest-VolumesGetTestJSON-871106965-project-member Apr 17 10:48:33 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:48:33 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:48:33 user devstack@n-api.service[72745]: X-User-Id: 4380aa2ce98245509156957910ae026a Apr 17 10:48:33 user devstack@n-api.service[72745]: X-User-Name: tempest-VolumesGetTestJSON-871106965-project-member Apr 17 10:48:33 user devstack@n-api.service[72745]: method: Apr 17 10:48:33 user devstack@n-api.service[72745]: exception: Volume ce290acf-9173-44d9-a149-13b5b8faf41f could not be found. Apr 17 10:48:33 user devstack@n-api.service[72745]: action_args: {'id': 'ce290acf-9173-44d9-a149-13b5b8faf41f'} Apr 17 10:48:33 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ce290acf-9173-44d9-a149-13b5b8faf41f could not be found. (HTTP 404) (Request-ID: req-8bb32963-cf13-44e2-8cf9-024077dba60e) Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ce290acf-9173-44d9-a149-13b5b8faf41f could not be found. Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ce290acf-9173-44d9-a149-13b5b8faf41f could not be found. Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ce290acf-9173-44d9-a149-13b5b8faf41f could not be found. Apr 17 10:48:33 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:48:33 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-d49b90bb-2950-43e9-a42e-7e8655a9ead2 tempest-VolumesGetTestJSON-871106965 tempest-VolumesGetTestJSON-871106965-project-member] Returning 404 to user: Volume ce290acf-9173-44d9-a149-13b5b8faf41f could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:48:33 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-d49b90bb-2950-43e9-a42e-7e8655a9ead2 tempest-VolumesGetTestJSON-871106965 tempest-VolumesGetTestJSON-871106965-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ce290acf-9173-44d9-a149-13b5b8faf41f" status: 404 len: 109 microversion: 2.1 time: 0.033488 Apr 17 10:48:33 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 222/644] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 10:48:33 2023] GET /compute/v2.1/os-volumes/ce290acf-9173-44d9-a149-13b5b8faf41f => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:48:37 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-fdfcc9f4-f1e7-469e-ab8b-88e28fc42951 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:48:37 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-fdfcc9f4-f1e7-469e-ab8b-88e28fc42951 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:48:37 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=4 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:48:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fdfcc9f4-f1e7-469e-ab8b-88e28fc42951 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fdfcc9f4-f1e7-469e-ab8b-88e28fc42951 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fdfcc9f4-f1e7-469e-ab8b-88e28fc42951 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fdfcc9f4-f1e7-469e-ab8b-88e28fc42951 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fdfcc9f4-f1e7-469e-ab8b-88e28fc42951 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fdfcc9f4-f1e7-469e-ab8b-88e28fc42951 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:37 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-fdfcc9f4-f1e7-469e-ab8b-88e28fc42951 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] HTTP exception thrown: Instance 288bc9dc-1698-4ca9-a670-5e219c04202b could not be found. Apr 17 10:48:37 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-fdfcc9f4-f1e7-469e-ab8b-88e28fc42951 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Request method failure captured: Apr 17 10:48:37 user devstack@n-api.service[72743]: request: DELETE /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b HTTP/1.1 Apr 17 10:48:37 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:48:37 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:48:37 user devstack@n-api.service[72743]: Connection: close Apr 17 10:48:37 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:48:37 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:48:37 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:48:37 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:48:37 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:48:37 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSC2U-PxTQNibFyn7A1yYJQ2OCxZjHmsnus6b0TVvFwoNVfsvv_nH14Ltyw4E8iMU6H2pZSlRL1UjLHUBMAXKWV-535N62tbhRrfE7gt2YL3MZzPrHSr9gwyC4tQ9ETt_SC51dCtR_N06y5qW_TL_VKyh7CJY12TnLzcy4JxJHpHIlM Apr 17 10:48:37 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:48:37 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:48:37 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:48:37 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:48:37 user devstack@n-api.service[72743]: X-Openstack-Nova-Api-Version: 2.20 Apr 17 10:48:37 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:48:37 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:48:37 user devstack@n-api.service[72743]: X-Project-Id: e6dac880f4294283ae7838bfa0edf5c1 Apr 17 10:48:37 user devstack@n-api.service[72743]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1174346715 Apr 17 10:48:37 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:48:37 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:48:37 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6dac880f4294283ae7838bfa0edf5c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6dac880f4294283ae7838bfa0edf5c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e6dac880f4294283ae7838bfa0edf5c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:48:37 user devstack@n-api.service[72743]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1174346715 Apr 17 10:48:37 user devstack@n-api.service[72743]: X-Tenant-Id: e6dac880f4294283ae7838bfa0edf5c1 Apr 17 10:48:37 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1174346715 Apr 17 10:48:37 user devstack@n-api.service[72743]: X-User: tempest-AttachVolumeShelveTestJSON-1174346715-project-member Apr 17 10:48:37 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:48:37 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:48:37 user devstack@n-api.service[72743]: X-User-Id: aea97828312f45ffa1b7148c375a7f9a Apr 17 10:48:37 user devstack@n-api.service[72743]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1174346715-project-member Apr 17 10:48:37 user devstack@n-api.service[72743]: method: > Apr 17 10:48:37 user devstack@n-api.service[72743]: exception: Instance 288bc9dc-1698-4ca9-a670-5e219c04202b could not be found. Apr 17 10:48:37 user devstack@n-api.service[72743]: action_args: {'id': '288bc9dc-1698-4ca9-a670-5e219c04202b'} Apr 17 10:48:37 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 288bc9dc-1698-4ca9-a670-5e219c04202b could not be found. Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 288bc9dc-1698-4ca9-a670-5e219c04202b could not be found. Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 288bc9dc-1698-4ca9-a670-5e219c04202b could not be found. Apr 17 10:48:37 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:48:37 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-fdfcc9f4-f1e7-469e-ab8b-88e28fc42951 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Returning 404 to user: Instance 288bc9dc-1698-4ca9-a670-5e219c04202b could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:48:37 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-fdfcc9f4-f1e7-469e-ab8b-88e28fc42951 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b" status: 404 len: 111 microversion: 2.20 time: 0.033330 Apr 17 10:48:37 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 218/645] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 17 10:48:37 2023] DELETE /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 10:48:37 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-de8ce94a-aad8-46b7-8959-7d5e164cea25 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:48:37 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-de8ce94a-aad8-46b7-8959-7d5e164cea25 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: 288bc9dc-1698-4ca9-a670-5e219c04202b] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:48:37 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:48:37 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=10 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:48:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-de8ce94a-aad8-46b7-8959-7d5e164cea25 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-de8ce94a-aad8-46b7-8959-7d5e164cea25 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-de8ce94a-aad8-46b7-8959-7d5e164cea25 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-de8ce94a-aad8-46b7-8959-7d5e164cea25 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-de8ce94a-aad8-46b7-8959-7d5e164cea25 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-de8ce94a-aad8-46b7-8959-7d5e164cea25 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:38 user devstack@n-api.service[72744]: INFO nova.api.openstack.wsgi [None req-de8ce94a-aad8-46b7-8959-7d5e164cea25 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] HTTP exception thrown: Instance 288bc9dc-1698-4ca9-a670-5e219c04202b could not be found. Apr 17 10:48:38 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-de8ce94a-aad8-46b7-8959-7d5e164cea25 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Request method failure captured: Apr 17 10:48:38 user devstack@n-api.service[72744]: request: GET /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b HTTP/1.1 Apr 17 10:48:38 user devstack@n-api.service[72744]: Accept: application/json Apr 17 10:48:38 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 10:48:38 user devstack@n-api.service[72744]: Connection: close Apr 17 10:48:38 user devstack@n-api.service[72744]: Content-Length: 0 Apr 17 10:48:38 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 10:48:38 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 10:48:38 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 10:48:38 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 10:48:38 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSC2U-PxTQNibFyn7A1yYJQ2OCxZjHmsnus6b0TVvFwoNVfsvv_nH14Ltyw4E8iMU6H2pZSlRL1UjLHUBMAXKWV-535N62tbhRrfE7gt2YL3MZzPrHSr9gwyC4tQ9ETt_SC51dCtR_N06y5qW_TL_VKyh7CJY12TnLzcy4JxJHpHIlM Apr 17 10:48:38 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 10:48:38 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 10:48:38 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 10:48:38 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 10:48:38 user devstack@n-api.service[72744]: X-Openstack-Nova-Api-Version: 2.20 Apr 17 10:48:38 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 10:48:38 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 10:48:38 user devstack@n-api.service[72744]: X-Project-Id: e6dac880f4294283ae7838bfa0edf5c1 Apr 17 10:48:38 user devstack@n-api.service[72744]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1174346715 Apr 17 10:48:38 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 10:48:38 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 10:48:38 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6dac880f4294283ae7838bfa0edf5c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6dac880f4294283ae7838bfa0edf5c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e6dac880f4294283ae7838bfa0edf5c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:48:38 user devstack@n-api.service[72744]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1174346715 Apr 17 10:48:38 user devstack@n-api.service[72744]: X-Tenant-Id: e6dac880f4294283ae7838bfa0edf5c1 Apr 17 10:48:38 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1174346715 Apr 17 10:48:38 user devstack@n-api.service[72744]: X-User: tempest-AttachVolumeShelveTestJSON-1174346715-project-member Apr 17 10:48:38 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 10:48:38 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 10:48:38 user devstack@n-api.service[72744]: X-User-Id: aea97828312f45ffa1b7148c375a7f9a Apr 17 10:48:38 user devstack@n-api.service[72744]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1174346715-project-member Apr 17 10:48:38 user devstack@n-api.service[72744]: method: > Apr 17 10:48:38 user devstack@n-api.service[72744]: exception: Instance 288bc9dc-1698-4ca9-a670-5e219c04202b could not be found. Apr 17 10:48:38 user devstack@n-api.service[72744]: action_args: {'id': '288bc9dc-1698-4ca9-a670-5e219c04202b'} Apr 17 10:48:38 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 288bc9dc-1698-4ca9-a670-5e219c04202b could not be found. Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 288bc9dc-1698-4ca9-a670-5e219c04202b could not be found. Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 288bc9dc-1698-4ca9-a670-5e219c04202b could not be found. Apr 17 10:48:38 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:48:38 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-de8ce94a-aad8-46b7-8959-7d5e164cea25 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Returning 404 to user: Instance 288bc9dc-1698-4ca9-a670-5e219c04202b could not be found. {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:48:38 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-de8ce94a-aad8-46b7-8959-7d5e164cea25 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b" status: 404 len: 111 microversion: 2.20 time: 0.032198 Apr 17 10:48:38 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 206/646] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:48:37 2023] GET /compute/v2.1/servers/288bc9dc-1698-4ca9-a670-5e219c04202b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 10:48:40 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-40974055-235e-43d5-85e0-fc12d3a97fe2 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Action: 'create', calling method: .version_select at 0x7fc55a7b7b50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-893387962", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORcRCSidzCtZERfUBnTDAnNSPELy1dgk6b9Q8gc8T4PAqATO1Uji336+kxtRXvHft6CLIvqnAvnpFG9PPMqkQyHfLPSq8yFarfYxhKHvEuKs5HLwpgj3LQxqJVyr1Uk0w=="}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:48:40 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-40974055-235e-43d5-85e0-fc12d3a97fe2 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Getting quotas for project 455ea6870abe450ba413ffabf4d4097e. Resources: {'key_pairs'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:48:40 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-40974055-235e-43d5-85e0-fc12d3a97fe2 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Getting quotas for user df693038f49145b9854ae18d246dde2f and project 455ea6870abe450ba413ffabf4d4097e. Resources: {'key_pairs'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:48:40 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-40974055-235e-43d5-85e0-fc12d3a97fe2 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.048040 Apr 17 10:48:40 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 223/647] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 10:48:40 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:48:40 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "a2e12569-124e-4a89-b6b9-db79f2df21d9"}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:48:40 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:48:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:40 user devstack@n-api.service[72743]: DEBUG nova.objects.instance [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lazy-loading 'flavor' on Instance uuid e198ad00-927f-45e1-9f14-828d56ce3393 {{(pid=72743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 10:48:40 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1426878970", "imageRef": "b9a4fcd5-2f1f-4db6-85be-390733594d1f", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-893387962", "networks": [{"uuid": "519dcb44-4125-4a92-9e76-0c22271f7ca8"}]}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:48:40 user devstack@n-api.service[72744]: DEBUG nova.network.neutron [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] validate_networks() for [('519dcb44-4125-4a92-9e76-0c22271f7ca8', None, None, None, None, None)] {{(pid=72744) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:48:41 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-1c24ec7d-e1cf-46ed-9015-8da981ff202e tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e198ad00-927f-45e1-9f14-828d56ce3393/action" status: 200 len: 29 microversion: 2.87 time: 0.483330 Apr 17 10:48:41 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 219/648] 10.0.0.210 () {66 vars in 1396 bytes} [Mon Apr 17 10:48:40 2023] POST /compute/v2.1/servers/e198ad00-927f-45e1-9f14-828d56ce3393/action => generated 29 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:48:41 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-355a7d0c-9b00-4d81-b8e2-a5e4c3533208 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:48:41 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-355a7d0c-9b00-4d81-b8e2-a5e4c3533208 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:48:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-355a7d0c-9b00-4d81-b8e2-a5e4c3533208 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-355a7d0c-9b00-4d81-b8e2-a5e4c3533208 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-355a7d0c-9b00-4d81-b8e2-a5e4c3533208 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-355a7d0c-9b00-4d81-b8e2-a5e4c3533208 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-355a7d0c-9b00-4d81-b8e2-a5e4c3533208 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-355a7d0c-9b00-4d81-b8e2-a5e4c3533208 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:41 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-355a7d0c-9b00-4d81-b8e2-a5e4c3533208 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:48:41 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-355a7d0c-9b00-4d81-b8e2-a5e4c3533208 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:48:41 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-355a7d0c-9b00-4d81-b8e2-a5e4c3533208 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:48:41 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-355a7d0c-9b00-4d81-b8e2-a5e4c3533208 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e198ad00-927f-45e1-9f14-828d56ce3393" status: 200 len: 1775 microversion: 2.87 time: 0.260418 Apr 17 10:48:41 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 224/649] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:48:41 2023] GET /compute/v2.1/servers/e198ad00-927f-45e1-9f14-828d56ce3393 => generated 1775 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:48:41 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-c5ada788-7abc-4c4a-a2fd-c1da693cdd50 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:48:41 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-c5ada788-7abc-4c4a-a2fd-c1da693cdd50 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:48:41 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c5ada788-7abc-4c4a-a2fd-c1da693cdd50 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:41 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c5ada788-7abc-4c4a-a2fd-c1da693cdd50 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:41 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c5ada788-7abc-4c4a-a2fd-c1da693cdd50 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:41 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c5ada788-7abc-4c4a-a2fd-c1da693cdd50 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:41 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Flavor limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:48:41 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Image limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:48:41 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c5ada788-7abc-4c4a-a2fd-c1da693cdd50 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:41 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Flavor pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:48:41 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Image pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:48:41 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c5ada788-7abc-4c4a-a2fd-c1da693cdd50 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:41 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:48:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:41 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-c5ada788-7abc-4c4a-a2fd-c1da693cdd50 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] HTTP exception thrown: Instance c4315753-415c-45cd-b06f-da1e3ccc6e4d could not be found. Apr 17 10:48:41 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-c5ada788-7abc-4c4a-a2fd-c1da693cdd50 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Request method failure captured: Apr 17 10:48:41 user devstack@n-api.service[72743]: request: DELETE /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d HTTP/1.1 Apr 17 10:48:41 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:48:41 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:48:41 user devstack@n-api.service[72743]: Connection: close Apr 17 10:48:41 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:48:41 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:48:41 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:48:41 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:48:41 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:48:41 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSC2U-PxTQNibFyn7A1yYJQ2OCxZjHmsnus6b0TVvFwoNVfsvv_nH14Ltyw4E8iMU6H2pZSlRL1UjLHUBMAXKWV-535N62tbhRrfE7gt2YL3MZzPrHSr9gwyC4tQ9ETt_SC51dCtR_N06y5qW_TL_VKyh7CJY12TnLzcy4JxJHpHIlM Apr 17 10:48:41 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:48:41 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:48:41 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:48:41 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:48:41 user devstack@n-api.service[72743]: X-Openstack-Nova-Api-Version: 2.20 Apr 17 10:48:41 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:48:41 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:48:41 user devstack@n-api.service[72743]: X-Project-Id: e6dac880f4294283ae7838bfa0edf5c1 Apr 17 10:48:41 user devstack@n-api.service[72743]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1174346715 Apr 17 10:48:41 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:48:41 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:48:41 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6dac880f4294283ae7838bfa0edf5c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6dac880f4294283ae7838bfa0edf5c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e6dac880f4294283ae7838bfa0edf5c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:48:41 user devstack@n-api.service[72743]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1174346715 Apr 17 10:48:41 user devstack@n-api.service[72743]: X-Tenant-Id: e6dac880f4294283ae7838bfa0edf5c1 Apr 17 10:48:41 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1174346715 Apr 17 10:48:41 user devstack@n-api.service[72743]: X-User: tempest-AttachVolumeShelveTestJSON-1174346715-project-member Apr 17 10:48:41 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:48:41 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:48:41 user devstack@n-api.service[72743]: X-User-Id: aea97828312f45ffa1b7148c375a7f9a Apr 17 10:48:41 user devstack@n-api.service[72743]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1174346715-project-member Apr 17 10:48:41 user devstack@n-api.service[72743]: method: > Apr 17 10:48:41 user devstack@n-api.service[72743]: exception: Instance c4315753-415c-45cd-b06f-da1e3ccc6e4d could not be found. Apr 17 10:48:41 user devstack@n-api.service[72743]: action_args: {'id': 'c4315753-415c-45cd-b06f-da1e3ccc6e4d'} Apr 17 10:48:41 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4315753-415c-45cd-b06f-da1e3ccc6e4d could not be found. Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4315753-415c-45cd-b06f-da1e3ccc6e4d could not be found. Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4315753-415c-45cd-b06f-da1e3ccc6e4d could not be found. Apr 17 10:48:41 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:48:41 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-c5ada788-7abc-4c4a-a2fd-c1da693cdd50 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Returning 404 to user: Instance c4315753-415c-45cd-b06f-da1e3ccc6e4d could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:48:41 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-c5ada788-7abc-4c4a-a2fd-c1da693cdd50 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d" status: 404 len: 111 microversion: 2.20 time: 0.030058 Apr 17 10:48:41 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 220/650] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 17 10:48:41 2023] DELETE /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 10:48:41 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-0934a17d-78d4-4b3c-bb08-b753d2f443b4 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:48:41 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-0934a17d-78d4-4b3c-bb08-b753d2f443b4 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] [instance: c4315753-415c-45cd-b06f-da1e3ccc6e4d] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:48:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0934a17d-78d4-4b3c-bb08-b753d2f443b4 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0934a17d-78d4-4b3c-bb08-b753d2f443b4 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0934a17d-78d4-4b3c-bb08-b753d2f443b4 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0934a17d-78d4-4b3c-bb08-b753d2f443b4 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:41 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Getting quotas for project 455ea6870abe450ba413ffabf4d4097e. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:48:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0934a17d-78d4-4b3c-bb08-b753d2f443b4 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-0934a17d-78d4-4b3c-bb08-b753d2f443b4 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:41 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Getting quotas for user df693038f49145b9854ae18d246dde2f and project 455ea6870abe450ba413ffabf4d4097e. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:48:41 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-0934a17d-78d4-4b3c-bb08-b753d2f443b4 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] HTTP exception thrown: Instance c4315753-415c-45cd-b06f-da1e3ccc6e4d could not be found. Apr 17 10:48:41 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-0934a17d-78d4-4b3c-bb08-b753d2f443b4 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Request method failure captured: Apr 17 10:48:41 user devstack@n-api.service[72745]: request: GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d HTTP/1.1 Apr 17 10:48:41 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:48:41 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:48:41 user devstack@n-api.service[72745]: Connection: close Apr 17 10:48:41 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 10:48:41 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:48:41 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:48:41 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:48:41 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:48:41 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSC2U-PxTQNibFyn7A1yYJQ2OCxZjHmsnus6b0TVvFwoNVfsvv_nH14Ltyw4E8iMU6H2pZSlRL1UjLHUBMAXKWV-535N62tbhRrfE7gt2YL3MZzPrHSr9gwyC4tQ9ETt_SC51dCtR_N06y5qW_TL_VKyh7CJY12TnLzcy4JxJHpHIlM Apr 17 10:48:41 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:48:41 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:48:41 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:48:41 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:48:41 user devstack@n-api.service[72745]: X-Openstack-Nova-Api-Version: 2.20 Apr 17 10:48:41 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:48:41 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:48:41 user devstack@n-api.service[72745]: X-Project-Id: e6dac880f4294283ae7838bfa0edf5c1 Apr 17 10:48:41 user devstack@n-api.service[72745]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1174346715 Apr 17 10:48:41 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:48:41 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:48:41 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6dac880f4294283ae7838bfa0edf5c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6dac880f4294283ae7838bfa0edf5c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e6dac880f4294283ae7838bfa0edf5c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:48:41 user devstack@n-api.service[72745]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1174346715 Apr 17 10:48:41 user devstack@n-api.service[72745]: X-Tenant-Id: e6dac880f4294283ae7838bfa0edf5c1 Apr 17 10:48:41 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1174346715 Apr 17 10:48:41 user devstack@n-api.service[72745]: X-User: tempest-AttachVolumeShelveTestJSON-1174346715-project-member Apr 17 10:48:41 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:48:41 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:48:41 user devstack@n-api.service[72745]: X-User-Id: aea97828312f45ffa1b7148c375a7f9a Apr 17 10:48:41 user devstack@n-api.service[72745]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1174346715-project-member Apr 17 10:48:41 user devstack@n-api.service[72745]: method: > Apr 17 10:48:41 user devstack@n-api.service[72745]: exception: Instance c4315753-415c-45cd-b06f-da1e3ccc6e4d could not be found. Apr 17 10:48:41 user devstack@n-api.service[72745]: action_args: {'id': 'c4315753-415c-45cd-b06f-da1e3ccc6e4d'} Apr 17 10:48:41 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4315753-415c-45cd-b06f-da1e3ccc6e4d could not be found. Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4315753-415c-45cd-b06f-da1e3ccc6e4d could not be found. Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4315753-415c-45cd-b06f-da1e3ccc6e4d could not be found. Apr 17 10:48:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:48:41 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-0934a17d-78d4-4b3c-bb08-b753d2f443b4 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] Returning 404 to user: Instance c4315753-415c-45cd-b06f-da1e3ccc6e4d could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:48:41 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-0934a17d-78d4-4b3c-bb08-b753d2f443b4 tempest-AttachVolumeShelveTestJSON-1174346715 tempest-AttachVolumeShelveTestJSON-1174346715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d" status: 404 len: 111 microversion: 2.20 time: 0.029915 Apr 17 10:48:41 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 225/651] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:48:41 2023] GET /compute/v2.1/servers/c4315753-415c-45cd-b06f-da1e3ccc6e4d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 10:48:41 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Going to run 1 instances... {{(pid=72744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:48:41 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a4fcd5-2f1f-4db6-85be-390733594d1f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:48:41 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-4f4c922d-7362-46bd-8df6-cfb6eccc049f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.822413 Apr 17 10:48:41 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 207/652] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:48:40 2023] POST /compute/v2.1/servers => generated 378 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 10:48:41 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-e589dd9d-c187-4723-950a-35ca27508a23 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:48:41 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-e589dd9d-c187-4723-950a-35ca27508a23 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:48:41 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-e589dd9d-c187-4723-950a-35ca27508a23 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df693038f49145b9854ae18d246dde2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455ea6870abe450ba413ffabf4d4097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:48:41 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-e589dd9d-c187-4723-950a-35ca27508a23 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315" status: 200 len: 1252 microversion: 2.1 time: 0.087986 Apr 17 10:48:41 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 221/653] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:48:41 2023] GET /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315 => generated 1252 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:48:42 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-c19e828c-2d3a-4904-ba84-7328fa8d2de1 req-ea0afe95-17d3-4efd-8bd9-071af5a85cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e198ad00-927f-45e1-9f14-828d56ce3393", "name": "network-vif-unplugged", "status": "completed", "tag": "8b03fa35-eaab-40ea-a06b-afa4bd410981"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:48:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-c19e828c-2d3a-4904-ba84-7328fa8d2de1 req-ea0afe95-17d3-4efd-8bd9-071af5a85cee service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-c19e828c-2d3a-4904-ba84-7328fa8d2de1 req-ea0afe95-17d3-4efd-8bd9-071af5a85cee service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-c19e828c-2d3a-4904-ba84-7328fa8d2de1 req-ea0afe95-17d3-4efd-8bd9-071af5a85cee service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:42 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-c19e828c-2d3a-4904-ba84-7328fa8d2de1 req-ea0afe95-17d3-4efd-8bd9-071af5a85cee service nova] Creating event network-vif-unplugged:8b03fa35-eaab-40ea-a06b-afa4bd410981 for instance e198ad00-927f-45e1-9f14-828d56ce3393 on user Apr 17 10:48:42 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-c19e828c-2d3a-4904-ba84-7328fa8d2de1 req-ea0afe95-17d3-4efd-8bd9-071af5a85cee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034219 Apr 17 10:48:42 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 226/654] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:48:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:48:42 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-05caefb0-7d15-46ca-aec2-412e1dcb4ca9 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:48:42 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-05caefb0-7d15-46ca-aec2-412e1dcb4ca9 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] [instance: 5e03807e-942b-4155-835b-b1c86f5b80f5] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:48:42 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-05caefb0-7d15-46ca-aec2-412e1dcb4ca9 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:42 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-05caefb0-7d15-46ca-aec2-412e1dcb4ca9 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:42 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-05caefb0-7d15-46ca-aec2-412e1dcb4ca9 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:42 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-05caefb0-7d15-46ca-aec2-412e1dcb4ca9 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:42 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-05caefb0-7d15-46ca-aec2-412e1dcb4ca9 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:42 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-05caefb0-7d15-46ca-aec2-412e1dcb4ca9 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:42 user devstack@n-api.service[72744]: INFO nova.api.openstack.wsgi [None req-05caefb0-7d15-46ca-aec2-412e1dcb4ca9 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] HTTP exception thrown: Instance 5e03807e-942b-4155-835b-b1c86f5b80f5 could not be found. Apr 17 10:48:42 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-05caefb0-7d15-46ca-aec2-412e1dcb4ca9 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Request method failure captured: Apr 17 10:48:42 user devstack@n-api.service[72744]: request: GET /compute/v2.1/servers/5e03807e-942b-4155-835b-b1c86f5b80f5 HTTP/1.1 Apr 17 10:48:42 user devstack@n-api.service[72744]: Accept: application/json Apr 17 10:48:42 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 10:48:42 user devstack@n-api.service[72744]: Connection: close Apr 17 10:48:42 user devstack@n-api.service[72744]: Content-Length: 0 Apr 17 10:48:42 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 10:48:42 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 10:48:42 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 10:48:42 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 10:48:42 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSHHBSxJU3GfcgBo4oxop3Utq3Ux8-8rgyX-78CWsY7DpxBUrhJrx5DFmxVDOSS779NXyNEKXanmdpZXAZeKA-EO7YcmTrVyRLEcXoVn2i1Ne2ZaWSUvSM9rm-nfHcTK7GVYQQzRVOzwsgq1B2sVUsCajeEIUJ_VlPPhRLKnXmI48Yo Apr 17 10:48:42 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 10:48:42 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 10:48:42 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 10:48:42 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 10:48:42 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 10:48:42 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 10:48:42 user devstack@n-api.service[72744]: X-Project-Id: a8b831c3b6c244dda1821583a6b8cd08 Apr 17 10:48:42 user devstack@n-api.service[72744]: X-Project-Name: tempest-ServersNegativeTestJSON-812869679 Apr 17 10:48:42 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 10:48:42 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 10:48:42 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a8b831c3b6c244dda1821583a6b8cd08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a8b831c3b6c244dda1821583a6b8cd08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a8b831c3b6c244dda1821583a6b8cd08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:48:42 user devstack@n-api.service[72744]: X-Tenant: tempest-ServersNegativeTestJSON-812869679 Apr 17 10:48:42 user devstack@n-api.service[72744]: X-Tenant-Id: a8b831c3b6c244dda1821583a6b8cd08 Apr 17 10:48:42 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-ServersNegativeTestJSON-812869679 Apr 17 10:48:42 user devstack@n-api.service[72744]: X-User: tempest-ServersNegativeTestJSON-812869679-project-member Apr 17 10:48:42 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 10:48:42 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 10:48:42 user devstack@n-api.service[72744]: X-User-Id: 1e61a5e172c34636b183ef9c84b714d8 Apr 17 10:48:42 user devstack@n-api.service[72744]: X-User-Name: tempest-ServersNegativeTestJSON-812869679-project-member Apr 17 10:48:42 user devstack@n-api.service[72744]: method: > Apr 17 10:48:42 user devstack@n-api.service[72744]: exception: Instance 5e03807e-942b-4155-835b-b1c86f5b80f5 could not be found. Apr 17 10:48:42 user devstack@n-api.service[72744]: action_args: {'id': '5e03807e-942b-4155-835b-b1c86f5b80f5'} Apr 17 10:48:42 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e03807e-942b-4155-835b-b1c86f5b80f5 could not be found. Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e03807e-942b-4155-835b-b1c86f5b80f5 could not be found. Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e03807e-942b-4155-835b-b1c86f5b80f5 could not be found. Apr 17 10:48:42 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:48:42 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-05caefb0-7d15-46ca-aec2-412e1dcb4ca9 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] Returning 404 to user: Instance 5e03807e-942b-4155-835b-b1c86f5b80f5 could not be found. {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:48:42 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-05caefb0-7d15-46ca-aec2-412e1dcb4ca9 tempest-ServersNegativeTestJSON-812869679 tempest-ServersNegativeTestJSON-812869679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e03807e-942b-4155-835b-b1c86f5b80f5" status: 404 len: 111 microversion: 2.1 time: 0.065472 Apr 17 10:48:42 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 208/655] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:48:42 2023] GET /compute/v2.1/servers/5e03807e-942b-4155-835b-b1c86f5b80f5 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:48:44 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-133dde44-a8c6-41cc-8036-3f8c323cb265 req-39b8e866-388d-46cc-a269-dbfd13b96905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e198ad00-927f-45e1-9f14-828d56ce3393", "name": "network-vif-plugged", "status": "completed", "tag": "8b03fa35-eaab-40ea-a06b-afa4bd410981"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:48:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-133dde44-a8c6-41cc-8036-3f8c323cb265 req-39b8e866-388d-46cc-a269-dbfd13b96905 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-133dde44-a8c6-41cc-8036-3f8c323cb265 req-39b8e866-388d-46cc-a269-dbfd13b96905 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-133dde44-a8c6-41cc-8036-3f8c323cb265 req-39b8e866-388d-46cc-a269-dbfd13b96905 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:44 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-133dde44-a8c6-41cc-8036-3f8c323cb265 req-39b8e866-388d-46cc-a269-dbfd13b96905 service nova] Creating event network-vif-plugged:8b03fa35-eaab-40ea-a06b-afa4bd410981 for instance e198ad00-927f-45e1-9f14-828d56ce3393 on user Apr 17 10:48:44 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-133dde44-a8c6-41cc-8036-3f8c323cb265 req-39b8e866-388d-46cc-a269-dbfd13b96905 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037453 Apr 17 10:48:44 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 222/656] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:48:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:48:44 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-f06a8ec9-b51e-48d7-9cc4-57577889b38e req-e2f79b8e-b2cc-4353-ab0d-7c7570e4e4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fd89020-5492-4e40-a911-63f9b1b43315", "tag": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:48:44 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-f06a8ec9-b51e-48d7-9cc4-57577889b38e req-e2f79b8e-b2cc-4353-ab0d-7c7570e4e4d2 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:44 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-f06a8ec9-b51e-48d7-9cc4-57577889b38e req-e2f79b8e-b2cc-4353-ab0d-7c7570e4e4d2 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:44 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-f06a8ec9-b51e-48d7-9cc4-57577889b38e req-e2f79b8e-b2cc-4353-ab0d-7c7570e4e4d2 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:44 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-f06a8ec9-b51e-48d7-9cc4-57577889b38e req-e2f79b8e-b2cc-4353-ab0d-7c7570e4e4d2 service nova] Creating event network-changed:65f23819-ccfb-4eb0-adc1-3f9895ed9c39 for instance 3fd89020-5492-4e40-a911-63f9b1b43315 on user Apr 17 10:48:44 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-f06a8ec9-b51e-48d7-9cc4-57577889b38e req-e2f79b8e-b2cc-4353-ab0d-7c7570e4e4d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030631 Apr 17 10:48:44 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 227/657] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:48:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:48:46 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-f6fab917-d381-4a71-8982-8de6e429c547 req-e29eb6fd-c348-40a5-b3fa-5c749c97dc18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e198ad00-927f-45e1-9f14-828d56ce3393", "name": "network-vif-plugged", "status": "completed", "tag": "8b03fa35-eaab-40ea-a06b-afa4bd410981"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:48:46 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-f6fab917-d381-4a71-8982-8de6e429c547 req-e29eb6fd-c348-40a5-b3fa-5c749c97dc18 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:46 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-f6fab917-d381-4a71-8982-8de6e429c547 req-e29eb6fd-c348-40a5-b3fa-5c749c97dc18 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:46 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-f6fab917-d381-4a71-8982-8de6e429c547 req-e29eb6fd-c348-40a5-b3fa-5c749c97dc18 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:46 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-f6fab917-d381-4a71-8982-8de6e429c547 req-e29eb6fd-c348-40a5-b3fa-5c749c97dc18 service nova] Creating event network-vif-plugged:8b03fa35-eaab-40ea-a06b-afa4bd410981 for instance e198ad00-927f-45e1-9f14-828d56ce3393 on user Apr 17 10:48:46 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-f6fab917-d381-4a71-8982-8de6e429c547 req-e29eb6fd-c348-40a5-b3fa-5c749c97dc18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066355 Apr 17 10:48:46 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 209/658] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:48:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:48:48 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-3d172458-7dbb-40ec-9094-8b3315cc8382 req-167959cc-df59-45fc-bed3-80817bc7dc77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e198ad00-927f-45e1-9f14-828d56ce3393", "name": "network-vif-plugged", "status": "completed", "tag": "8b03fa35-eaab-40ea-a06b-afa4bd410981"}, {"server_uuid": "3fd89020-5492-4e40-a911-63f9b1b43315", "name": "network-vif-plugged", "status": "completed", "tag": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:48:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-3d172458-7dbb-40ec-9094-8b3315cc8382 req-167959cc-df59-45fc-bed3-80817bc7dc77 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-3d172458-7dbb-40ec-9094-8b3315cc8382 req-167959cc-df59-45fc-bed3-80817bc7dc77 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-3d172458-7dbb-40ec-9094-8b3315cc8382 req-167959cc-df59-45fc-bed3-80817bc7dc77 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:49 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-3d172458-7dbb-40ec-9094-8b3315cc8382 req-167959cc-df59-45fc-bed3-80817bc7dc77 service nova] Creating event network-vif-plugged:8b03fa35-eaab-40ea-a06b-afa4bd410981 for instance e198ad00-927f-45e1-9f14-828d56ce3393 on user Apr 17 10:48:49 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-3d172458-7dbb-40ec-9094-8b3315cc8382 req-167959cc-df59-45fc-bed3-80817bc7dc77 service nova] Creating event network-vif-plugged:65f23819-ccfb-4eb0-adc1-3f9895ed9c39 for instance 3fd89020-5492-4e40-a911-63f9b1b43315 on user Apr 17 10:48:49 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-3d172458-7dbb-40ec-9094-8b3315cc8382 req-167959cc-df59-45fc-bed3-80817bc7dc77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071151 Apr 17 10:48:49 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 223/659] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:48:48 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:48:51 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=4 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:48:51 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-5966298f-368e-4414-9ba4-f07f0fdb2918 req-e064c6f9-ed83-42f1-ad38-899b782c4a3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd89020-5492-4e40-a911-63f9b1b43315", "name": "network-vif-plugged", "status": "completed", "tag": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:48:51 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-5966298f-368e-4414-9ba4-f07f0fdb2918 req-e064c6f9-ed83-42f1-ad38-899b782c4a3b service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:48:51 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-5966298f-368e-4414-9ba4-f07f0fdb2918 req-e064c6f9-ed83-42f1-ad38-899b782c4a3b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:48:51 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-5966298f-368e-4414-9ba4-f07f0fdb2918 req-e064c6f9-ed83-42f1-ad38-899b782c4a3b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:48:51 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-5966298f-368e-4414-9ba4-f07f0fdb2918 req-e064c6f9-ed83-42f1-ad38-899b782c4a3b service nova] Creating event network-vif-plugged:65f23819-ccfb-4eb0-adc1-3f9895ed9c39 for instance 3fd89020-5492-4e40-a911-63f9b1b43315 on user Apr 17 10:48:51 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-5966298f-368e-4414-9ba4-f07f0fdb2918 req-e064c6f9-ed83-42f1-ad38-899b782c4a3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039289 Apr 17 10:48:51 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 228/660] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:48:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:49:11 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:49:11 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:49:11 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:49:11 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=8 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:49:11 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-f2d138f7-7898-43ec-bec7-eda5232ba82e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:49:11 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-f2d138f7-7898-43ec-bec7-eda5232ba82e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:49:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f2d138f7-7898-43ec-bec7-eda5232ba82e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f2d138f7-7898-43ec-bec7-eda5232ba82e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f2d138f7-7898-43ec-bec7-eda5232ba82e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f2d138f7-7898-43ec-bec7-eda5232ba82e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f2d138f7-7898-43ec-bec7-eda5232ba82e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f2d138f7-7898-43ec-bec7-eda5232ba82e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:11 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-f2d138f7-7898-43ec-bec7-eda5232ba82e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:49:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-f2d138f7-7898-43ec-bec7-eda5232ba82e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 200 len: 1655 microversion: 2.1 time: 0.302617 Apr 17 10:49:11 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 210/661] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:49:11 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 1655 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:49:11 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed14165c-7141-4cb0-816c-aa875719d300"}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:49:11 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:49:11 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:49:11 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:49:11 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:49:11 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:11 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:11 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:11 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:11 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:11 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:12 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-c7e41547-8398-4cb1-940b-b4319e78c1b2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329143 Apr 17 10:49:12 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 224/662] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Apr 17 10:49:11 2023] POST /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/os-volume_attachments => generated 194 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:49:20 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:49:20 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=18 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:49:20 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-bbb3577e-408c-4cc0-9b7a-eb572457a5da tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:49:20 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-bbb3577e-408c-4cc0-9b7a-eb572457a5da tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:49:20 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-bbb3577e-408c-4cc0-9b7a-eb572457a5da tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:20 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-bbb3577e-408c-4cc0-9b7a-eb572457a5da tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:20 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-bbb3577e-408c-4cc0-9b7a-eb572457a5da tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:20 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-bbb3577e-408c-4cc0-9b7a-eb572457a5da tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:20 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-bbb3577e-408c-4cc0-9b7a-eb572457a5da tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:20 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-bbb3577e-408c-4cc0-9b7a-eb572457a5da tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:21 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-bbb3577e-408c-4cc0-9b7a-eb572457a5da tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:49:21 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-bbb3577e-408c-4cc0-9b7a-eb572457a5da tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 200 len: 1701 microversion: 2.1 time: 0.267735 Apr 17 10:49:21 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 229/663] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:49:20 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 1701 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:49:21 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-1036404855", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:49:21 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:49:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:21 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting quotas for project cc1b39ff9581474b87c58164e5cafa00. Resources: dict_keys(['metadata_items']) {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:49:21 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting quotas for user a7e218d771db49e88d13d3b088f3d88a and project cc1b39ff9581474b87c58164e5cafa00. Resources: dict_keys(['metadata_items']) {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:49:21 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flavor limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:49:21 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Image limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:49:21 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flavor pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:49:21 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Image pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:49:21 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:49:21 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:49:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:21 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-dbe2ace4-1759-4614-9120-4489f26bedb2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/action" status: 202 len: 1159 microversion: 2.1 time: 0.335771 Apr 17 10:49:21 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 211/664] 10.0.0.210 () {64 vars in 1356 bytes} [Mon Apr 17 10:49:21 2023] POST /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/action => generated 1159 bytes in 337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 17 10:49:21 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-ddf01792-d943-4f37-9a1d-71571fb88305 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:49:21 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-ddf01792-d943-4f37-9a1d-71571fb88305 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:49:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ddf01792-d943-4f37-9a1d-71571fb88305 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ddf01792-d943-4f37-9a1d-71571fb88305 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ddf01792-d943-4f37-9a1d-71571fb88305 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ddf01792-d943-4f37-9a1d-71571fb88305 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ddf01792-d943-4f37-9a1d-71571fb88305 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ddf01792-d943-4f37-9a1d-71571fb88305 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:21 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-ddf01792-d943-4f37-9a1d-71571fb88305 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:49:21 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-ddf01792-d943-4f37-9a1d-71571fb88305 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 200 len: 1730 microversion: 2.1 time: 0.266839 Apr 17 10:49:21 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 225/665] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:49:21 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 1730 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:49:22 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-1c334bd0-78d2-4ad8-ab3d-eef72c8c9f36 req-5aa167d4-d6dc-4102-a696-e6e9d7ff61f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38", "name": "network-vif-unplugged", "status": "completed", "tag": "67386c8f-911d-4398-b449-42af25f6afe3"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:49:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-1c334bd0-78d2-4ad8-ab3d-eef72c8c9f36 req-5aa167d4-d6dc-4102-a696-e6e9d7ff61f7 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-1c334bd0-78d2-4ad8-ab3d-eef72c8c9f36 req-5aa167d4-d6dc-4102-a696-e6e9d7ff61f7 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-1c334bd0-78d2-4ad8-ab3d-eef72c8c9f36 req-5aa167d4-d6dc-4102-a696-e6e9d7ff61f7 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:22 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-1c334bd0-78d2-4ad8-ab3d-eef72c8c9f36 req-5aa167d4-d6dc-4102-a696-e6e9d7ff61f7 service nova] Creating event network-vif-unplugged:67386c8f-911d-4398-b449-42af25f6afe3 for instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 on user Apr 17 10:49:22 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-1c334bd0-78d2-4ad8-ab3d-eef72c8c9f36 req-5aa167d4-d6dc-4102-a696-e6e9d7ff61f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034168 Apr 17 10:49:22 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 230/666] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:49:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:49:24 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-67bf0c7d-aff3-4548-85cf-48d022f347be req-ca8b0d0e-c96b-4c48-bc47-34be1326c7fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38", "name": "network-vif-plugged", "status": "completed", "tag": "67386c8f-911d-4398-b449-42af25f6afe3"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:49:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-67bf0c7d-aff3-4548-85cf-48d022f347be req-ca8b0d0e-c96b-4c48-bc47-34be1326c7fc service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-67bf0c7d-aff3-4548-85cf-48d022f347be req-ca8b0d0e-c96b-4c48-bc47-34be1326c7fc service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-67bf0c7d-aff3-4548-85cf-48d022f347be req-ca8b0d0e-c96b-4c48-bc47-34be1326c7fc service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:24 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-67bf0c7d-aff3-4548-85cf-48d022f347be req-ca8b0d0e-c96b-4c48-bc47-34be1326c7fc service nova] Creating event network-vif-plugged:67386c8f-911d-4398-b449-42af25f6afe3 for instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 on user Apr 17 10:49:24 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-67bf0c7d-aff3-4548-85cf-48d022f347be req-ca8b0d0e-c96b-4c48-bc47-34be1326c7fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044235 Apr 17 10:49:24 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 212/667] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:49:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:49:26 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-1841ca14-ae17-4287-9dee-f9194458d8a7 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:49:26 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-1841ca14-ae17-4287-9dee-f9194458d8a7 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:49:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-1841ca14-ae17-4287-9dee-f9194458d8a7 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-1841ca14-ae17-4287-9dee-f9194458d8a7 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-1841ca14-ae17-4287-9dee-f9194458d8a7 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-1841ca14-ae17-4287-9dee-f9194458d8a7 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-1841ca14-ae17-4287-9dee-f9194458d8a7 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-1841ca14-ae17-4287-9dee-f9194458d8a7 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:26 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-1841ca14-ae17-4287-9dee-f9194458d8a7 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708740584a3d488da0ee13e5f8299b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84cd384dfcbb4739b9694704c1fad001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:49:26 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-1841ca14-ae17-4287-9dee-f9194458d8a7 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a23c573c-7547-4739-bf72-ad8fa8fab7ed" status: 200 len: 1534 microversion: 2.1 time: 0.647599 Apr 17 10:49:26 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 226/668] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:49:25 2023] GET /compute/v2.1/servers/a23c573c-7547-4739-bf72-ad8fa8fab7ed => generated 1534 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:49:28 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-35c4d573-00df-4f64-910a-38e0d438abb1 req-40b65590-ee60-451c-bc70-ceea7f138ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a23c573c-7547-4739-bf72-ad8fa8fab7ed", "tag": "d676d231-6c3e-427a-83f1-caab25925cd6"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:49:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-35c4d573-00df-4f64-910a-38e0d438abb1 req-40b65590-ee60-451c-bc70-ceea7f138ec0 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-35c4d573-00df-4f64-910a-38e0d438abb1 req-40b65590-ee60-451c-bc70-ceea7f138ec0 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-35c4d573-00df-4f64-910a-38e0d438abb1 req-40b65590-ee60-451c-bc70-ceea7f138ec0 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:28 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-35c4d573-00df-4f64-910a-38e0d438abb1 req-40b65590-ee60-451c-bc70-ceea7f138ec0 service nova] Creating event network-changed:d676d231-6c3e-427a-83f1-caab25925cd6 for instance a23c573c-7547-4739-bf72-ad8fa8fab7ed on user Apr 17 10:49:28 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-35c4d573-00df-4f64-910a-38e0d438abb1 req-40b65590-ee60-451c-bc70-ceea7f138ec0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045023 Apr 17 10:49:28 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 231/669] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:49:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:49:28 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88e4223b-2a7a-4d14-aad9-ab3348ebe460"}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:49:28 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:49:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:28 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-29af99bf-ec78-4e2a-989a-c80484af431b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a23c573c-7547-4739-bf72-ad8fa8fab7ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.360779 Apr 17 10:49:28 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 213/670] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Apr 17 10:49:28 2023] POST /compute/v2.1/servers/a23c573c-7547-4739-bf72-ad8fa8fab7ed/os-volume_attachments => generated 194 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:49:31 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-fea79c70-aec1-486d-be54-01abb07d1fb9 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:49:31 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-fea79c70-aec1-486d-be54-01abb07d1fb9 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:49:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fea79c70-aec1-486d-be54-01abb07d1fb9 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fea79c70-aec1-486d-be54-01abb07d1fb9 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fea79c70-aec1-486d-be54-01abb07d1fb9 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fea79c70-aec1-486d-be54-01abb07d1fb9 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fea79c70-aec1-486d-be54-01abb07d1fb9 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fea79c70-aec1-486d-be54-01abb07d1fb9 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:31 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-237f9dd5-60f4-409a-8562-b467013b074f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:49:31 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-237f9dd5-60f4-409a-8562-b467013b074f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:49:31 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-237f9dd5-60f4-409a-8562-b467013b074f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:31 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-237f9dd5-60f4-409a-8562-b467013b074f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:31 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-237f9dd5-60f4-409a-8562-b467013b074f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:31 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-237f9dd5-60f4-409a-8562-b467013b074f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:31 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-237f9dd5-60f4-409a-8562-b467013b074f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:31 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-237f9dd5-60f4-409a-8562-b467013b074f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:32 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-237f9dd5-60f4-409a-8562-b467013b074f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df693038f49145b9854ae18d246dde2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455ea6870abe450ba413ffabf4d4097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:49:32 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-237f9dd5-60f4-409a-8562-b467013b074f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315" status: 200 len: 1535 microversion: 2.1 time: 0.411965 Apr 17 10:49:32 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 232/671] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:49:31 2023] GET /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315 => generated 1535 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:49:32 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-fea79c70-aec1-486d-be54-01abb07d1fb9 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:49:32 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-fea79c70-aec1-486d-be54-01abb07d1fb9 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:49:32 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-fea79c70-aec1-486d-be54-01abb07d1fb9 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:49:32 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-fea79c70-aec1-486d-be54-01abb07d1fb9 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e198ad00-927f-45e1-9f14-828d56ce3393" status: 200 len: 1755 microversion: 2.87 time: 0.714920 Apr 17 10:49:32 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 227/672] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:49:31 2023] GET /compute/v2.1/servers/e198ad00-927f-45e1-9f14-828d56ce3393 => generated 1755 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:49:36 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-9e1fb91d-f66d-40dc-aff0-f9b80769bf0d req-eda3b2bd-cd24-4540-83c5-a2c92130e7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38", "name": "network-vif-plugged", "status": "completed", "tag": "67386c8f-911d-4398-b449-42af25f6afe3"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:49:36 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-9e1fb91d-f66d-40dc-aff0-f9b80769bf0d req-eda3b2bd-cd24-4540-83c5-a2c92130e7b5 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:36 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-9e1fb91d-f66d-40dc-aff0-f9b80769bf0d req-eda3b2bd-cd24-4540-83c5-a2c92130e7b5 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:36 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-9e1fb91d-f66d-40dc-aff0-f9b80769bf0d req-eda3b2bd-cd24-4540-83c5-a2c92130e7b5 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:36 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-9e1fb91d-f66d-40dc-aff0-f9b80769bf0d req-eda3b2bd-cd24-4540-83c5-a2c92130e7b5 service nova] Creating event network-vif-plugged:67386c8f-911d-4398-b449-42af25f6afe3 for instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 on user Apr 17 10:49:36 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-9e1fb91d-f66d-40dc-aff0-f9b80769bf0d req-eda3b2bd-cd24-4540-83c5-a2c92130e7b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031460 Apr 17 10:49:36 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 214/673] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:49:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:49:37 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:49:37 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:49:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:37 user devstack@n-api.service[72745]: DEBUG nova.objects.instance [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lazy-loading 'services' on Instance uuid a23c573c-7547-4739-bf72-ad8fa8fab7ed {{(pid=72745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 10:49:37 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-ecc806b9-f462-460a-809c-1a64ad12f259 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a23c573c-7547-4739-bf72-ad8fa8fab7ed/os-volume_attachments/88e4223b-2a7a-4d14-aad9-ab3348ebe460" status: 202 len: 0 microversion: 2.1 time: 0.168736 Apr 17 10:49:37 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 233/674] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Apr 17 10:49:37 2023] DELETE /compute/v2.1/servers/a23c573c-7547-4739-bf72-ad8fa8fab7ed/os-volume_attachments/88e4223b-2a7a-4d14-aad9-ab3348ebe460 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 17 10:49:37 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-6fd74c3f-7b86-4d68-920d-240a3b0c41ce tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:49:38 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-6fd74c3f-7b86-4d68-920d-240a3b0c41ce tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:49:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6fd74c3f-7b86-4d68-920d-240a3b0c41ce tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6fd74c3f-7b86-4d68-920d-240a3b0c41ce tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6fd74c3f-7b86-4d68-920d-240a3b0c41ce tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6fd74c3f-7b86-4d68-920d-240a3b0c41ce tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6fd74c3f-7b86-4d68-920d-240a3b0c41ce tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6fd74c3f-7b86-4d68-920d-240a3b0c41ce tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:38 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-6fd74c3f-7b86-4d68-920d-240a3b0c41ce tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a23c573c-7547-4739-bf72-ad8fa8fab7ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057935 Apr 17 10:49:38 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 228/675] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:49:37 2023] GET /compute/v2.1/servers/a23c573c-7547-4739-bf72-ad8fa8fab7ed/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:49:38 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-c2f74c31-3e03-427a-9d7f-ff2e5744a42a req-32603dc9-96eb-4ae6-ab0d-0ced7214fd19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38", "name": "network-vif-plugged", "status": "completed", "tag": "67386c8f-911d-4398-b449-42af25f6afe3"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:49:38 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-c2f74c31-3e03-427a-9d7f-ff2e5744a42a req-32603dc9-96eb-4ae6-ab0d-0ced7214fd19 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:38 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-c2f74c31-3e03-427a-9d7f-ff2e5744a42a req-32603dc9-96eb-4ae6-ab0d-0ced7214fd19 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:38 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-c2f74c31-3e03-427a-9d7f-ff2e5744a42a req-32603dc9-96eb-4ae6-ab0d-0ced7214fd19 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:38 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-c2f74c31-3e03-427a-9d7f-ff2e5744a42a req-32603dc9-96eb-4ae6-ab0d-0ced7214fd19 service nova] Creating event network-vif-plugged:67386c8f-911d-4398-b449-42af25f6afe3 for instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 on user Apr 17 10:49:38 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-c2f74c31-3e03-427a-9d7f-ff2e5744a42a req-32603dc9-96eb-4ae6-ab0d-0ced7214fd19 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032573 Apr 17 10:49:38 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 215/676] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:49:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:49:45 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1095013513", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "networks": [{"uuid": "5b563383-5272-4d22-a617-c3a91d7b84c9"}]}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:49:45 user devstack@n-api.service[72745]: DEBUG nova.network.neutron [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] validate_networks() for [('5b563383-5272-4d22-a617-c3a91d7b84c9', None, None, None, None, None)] {{(pid=72745) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:49:45 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Flavor limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:49:45 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Image limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:49:45 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Flavor pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:49:45 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Image pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:49:45 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:49:45 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:45 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:45 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:45 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:45 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:45 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:45 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Getting quotas for project 652f9a7f20954e23b143e349c538f418. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:49:45 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Getting quotas for user 30ad2b6b478547e78e2cf273ef0390ed and project 652f9a7f20954e23b143e349c538f418. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:49:45 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Going to run 1 instances... {{(pid=72745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:49:45 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:49:46 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-6e745ac1-c52d-4934-a7bb-4a2ee6b29869 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.591661 Apr 17 10:49:46 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 234/677] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:49:45 2023] POST /compute/v2.1/servers => generated 378 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 10:49:46 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-8bbadc1a-491e-4f7a-86f7-c9783154be58 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:49:46 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-8bbadc1a-491e-4f7a-86f7-c9783154be58 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:49:46 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=13 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:49:46 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-8bbadc1a-491e-4f7a-86f7-c9783154be58 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad2b6b478547e78e2cf273ef0390ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652f9a7f20954e23b143e349c538f418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:49:46 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-8bbadc1a-491e-4f7a-86f7-c9783154be58 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7fabb8d9-4062-418a-b890-48c4b45cf9cf" status: 200 len: 1213 microversion: 2.1 time: 0.073065 Apr 17 10:49:46 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 229/678] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:49:46 2023] GET /compute/v2.1/servers/7fabb8d9-4062-418a-b890-48c4b45cf9cf => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:49:49 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=24 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:49:49 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=6,nova_cell1:INSERT=3,nova_cell1:DELETE=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:49:49 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-3a7d91d6-2fbf-46e7-8382-b5e2691c6664 req-c830ba20-2521-4103-9ed4-72353383e2ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fabb8d9-4062-418a-b890-48c4b45cf9cf", "tag": "63e11d1a-088d-4c09-b938-48d54ba791fd"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:49:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-3a7d91d6-2fbf-46e7-8382-b5e2691c6664 req-c830ba20-2521-4103-9ed4-72353383e2ad service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-3a7d91d6-2fbf-46e7-8382-b5e2691c6664 req-c830ba20-2521-4103-9ed4-72353383e2ad service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-3a7d91d6-2fbf-46e7-8382-b5e2691c6664 req-c830ba20-2521-4103-9ed4-72353383e2ad service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:49 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-3a7d91d6-2fbf-46e7-8382-b5e2691c6664 req-c830ba20-2521-4103-9ed4-72353383e2ad service nova] Creating event network-changed:63e11d1a-088d-4c09-b938-48d54ba791fd for instance 7fabb8d9-4062-418a-b890-48c4b45cf9cf on user Apr 17 10:49:49 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-3a7d91d6-2fbf-46e7-8382-b5e2691c6664 req-c830ba20-2521-4103-9ed4-72353383e2ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045135 Apr 17 10:49:49 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 216/679] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:49:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 10:49:51 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-464f101d-c7da-4942-a4bf-76eabb530790 req-1dd70b3b-52ef-44a7-a7ae-5693542fdd0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fabb8d9-4062-418a-b890-48c4b45cf9cf", "name": "network-vif-plugged", "status": "completed", "tag": "63e11d1a-088d-4c09-b938-48d54ba791fd"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:49:51 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:49:51 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-464f101d-c7da-4942-a4bf-76eabb530790 req-1dd70b3b-52ef-44a7-a7ae-5693542fdd0f service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:51 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-464f101d-c7da-4942-a4bf-76eabb530790 req-1dd70b3b-52ef-44a7-a7ae-5693542fdd0f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:51 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-464f101d-c7da-4942-a4bf-76eabb530790 req-1dd70b3b-52ef-44a7-a7ae-5693542fdd0f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:51 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=28,nova_cell1:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:49:51 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-464f101d-c7da-4942-a4bf-76eabb530790 req-1dd70b3b-52ef-44a7-a7ae-5693542fdd0f service nova] Creating event network-vif-plugged:63e11d1a-088d-4c09-b938-48d54ba791fd for instance 7fabb8d9-4062-418a-b890-48c4b45cf9cf on user Apr 17 10:49:51 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-464f101d-c7da-4942-a4bf-76eabb530790 req-1dd70b3b-52ef-44a7-a7ae-5693542fdd0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036605 Apr 17 10:49:51 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 235/680] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:49:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:49:53 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-56b9ab7d-c79a-484d-a566-0caa066d302f req-5f567488-d726-450a-97a7-3887f881d78f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fabb8d9-4062-418a-b890-48c4b45cf9cf", "name": "network-vif-plugged", "status": "completed", "tag": "63e11d1a-088d-4c09-b938-48d54ba791fd"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:49:53 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:49:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-56b9ab7d-c79a-484d-a566-0caa066d302f req-5f567488-d726-450a-97a7-3887f881d78f service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:49:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-56b9ab7d-c79a-484d-a566-0caa066d302f req-5f567488-d726-450a-97a7-3887f881d78f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:49:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-56b9ab7d-c79a-484d-a566-0caa066d302f req-5f567488-d726-450a-97a7-3887f881d78f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:49:53 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-56b9ab7d-c79a-484d-a566-0caa066d302f req-5f567488-d726-450a-97a7-3887f881d78f service nova] Creating event network-vif-plugged:63e11d1a-088d-4c09-b938-48d54ba791fd for instance 7fabb8d9-4062-418a-b890-48c4b45cf9cf on user Apr 17 10:49:53 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-56b9ab7d-c79a-484d-a566-0caa066d302f req-5f567488-d726-450a-97a7-3887f881d78f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053665 Apr 17 10:49:53 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 230/681] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:49:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:50:11 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:50:11 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:50:11 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-ad2c1e35-82ba-4c97-9b3c-8dadc235e2fc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:50:11 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-ad2c1e35-82ba-4c97-9b3c-8dadc235e2fc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:50:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ad2c1e35-82ba-4c97-9b3c-8dadc235e2fc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ad2c1e35-82ba-4c97-9b3c-8dadc235e2fc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ad2c1e35-82ba-4c97-9b3c-8dadc235e2fc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ad2c1e35-82ba-4c97-9b3c-8dadc235e2fc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ad2c1e35-82ba-4c97-9b3c-8dadc235e2fc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ad2c1e35-82ba-4c97-9b3c-8dadc235e2fc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:12 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-ad2c1e35-82ba-4c97-9b3c-8dadc235e2fc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:50:12 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-ad2c1e35-82ba-4c97-9b3c-8dadc235e2fc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 200 len: 1721 microversion: 2.1 time: 0.757979 Apr 17 10:50:12 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 217/682] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:50:11 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 1721 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:50:28 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-1b5d884a-5c9b-4ad6-832e-6a98d697f038 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:50:28 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-1b5d884a-5c9b-4ad6-832e-6a98d697f038 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:50:28 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:50:28 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:50:28 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:50:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1b5d884a-5c9b-4ad6-832e-6a98d697f038 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1b5d884a-5c9b-4ad6-832e-6a98d697f038 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1b5d884a-5c9b-4ad6-832e-6a98d697f038 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1b5d884a-5c9b-4ad6-832e-6a98d697f038 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1b5d884a-5c9b-4ad6-832e-6a98d697f038 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1b5d884a-5c9b-4ad6-832e-6a98d697f038 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:28 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-1b5d884a-5c9b-4ad6-832e-6a98d697f038 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a23c573c-7547-4739-bf72-ad8fa8fab7ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061848 Apr 17 10:50:28 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 236/683] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:50:28 2023] GET /compute/v2.1/servers/a23c573c-7547-4739-bf72-ad8fa8fab7ed/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 17 10:50:28 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:50:28 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=5 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:50:28 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:50:28 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:50:28 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:50:28 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:50:28 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:50:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:28 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Going to try to terminate instance {{(pid=72743) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:50:28 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-fb092f23-eba7-46e0-94d8-a25761367529 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a23c573c-7547-4739-bf72-ad8fa8fab7ed" status: 204 len: 0 microversion: 2.1 time: 0.163228 Apr 17 10:50:28 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 231/684] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:50:28 2023] DELETE /compute/v2.1/servers/a23c573c-7547-4739-bf72-ad8fa8fab7ed => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 17 10:50:28 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-aa12db42-8279-4f21-9db0-49e0a3d56355 req-9006213a-8ec8-4ee6-a0f2-d8448995ee1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a23c573c-7547-4739-bf72-ad8fa8fab7ed", "tag": "d676d231-6c3e-427a-83f1-caab25925cd6"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:50:28 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-d27f579f-735b-49f1-b119-0c13ee2416eb tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:50:28 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-d27f579f-735b-49f1-b119-0c13ee2416eb tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:50:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d27f579f-735b-49f1-b119-0c13ee2416eb tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d27f579f-735b-49f1-b119-0c13ee2416eb tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-aa12db42-8279-4f21-9db0-49e0a3d56355 req-9006213a-8ec8-4ee6-a0f2-d8448995ee1a service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d27f579f-735b-49f1-b119-0c13ee2416eb tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-aa12db42-8279-4f21-9db0-49e0a3d56355 req-9006213a-8ec8-4ee6-a0f2-d8448995ee1a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-aa12db42-8279-4f21-9db0-49e0a3d56355 req-9006213a-8ec8-4ee6-a0f2-d8448995ee1a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d27f579f-735b-49f1-b119-0c13ee2416eb tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d27f579f-735b-49f1-b119-0c13ee2416eb tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d27f579f-735b-49f1-b119-0c13ee2416eb tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:28 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-aa12db42-8279-4f21-9db0-49e0a3d56355 req-9006213a-8ec8-4ee6-a0f2-d8448995ee1a service nova] Creating event network-changed:d676d231-6c3e-427a-83f1-caab25925cd6 for instance a23c573c-7547-4739-bf72-ad8fa8fab7ed on user Apr 17 10:50:28 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-aa12db42-8279-4f21-9db0-49e0a3d56355 req-9006213a-8ec8-4ee6-a0f2-d8448995ee1a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187328 Apr 17 10:50:28 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 218/685] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:50:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:50:29 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-d27f579f-735b-49f1-b119-0c13ee2416eb tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708740584a3d488da0ee13e5f8299b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84cd384dfcbb4739b9694704c1fad001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:50:29 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-d27f579f-735b-49f1-b119-0c13ee2416eb tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a23c573c-7547-4739-bf72-ad8fa8fab7ed" status: 200 len: 1659 microversion: 2.1 time: 0.269346 Apr 17 10:50:29 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 237/686] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:50:28 2023] GET /compute/v2.1/servers/a23c573c-7547-4739-bf72-ad8fa8fab7ed => generated 1659 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:50:30 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-757ece74-10db-44b4-b672-113f55fb7e42 req-a77e6c47-5257-40b2-896a-e33eb91e4410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a23c573c-7547-4739-bf72-ad8fa8fab7ed", "name": "network-vif-unplugged", "status": "completed", "tag": "d676d231-6c3e-427a-83f1-caab25925cd6"}, {"server_uuid": "a23c573c-7547-4739-bf72-ad8fa8fab7ed", "name": "network-vif-plugged", "status": "completed", "tag": "d676d231-6c3e-427a-83f1-caab25925cd6"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:50:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-757ece74-10db-44b4-b672-113f55fb7e42 req-a77e6c47-5257-40b2-896a-e33eb91e4410 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-757ece74-10db-44b4-b672-113f55fb7e42 req-a77e6c47-5257-40b2-896a-e33eb91e4410 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-757ece74-10db-44b4-b672-113f55fb7e42 req-a77e6c47-5257-40b2-896a-e33eb91e4410 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:31 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-757ece74-10db-44b4-b672-113f55fb7e42 req-a77e6c47-5257-40b2-896a-e33eb91e4410 service nova] Creating event network-vif-unplugged:d676d231-6c3e-427a-83f1-caab25925cd6 for instance a23c573c-7547-4739-bf72-ad8fa8fab7ed on user Apr 17 10:50:31 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-757ece74-10db-44b4-b672-113f55fb7e42 req-a77e6c47-5257-40b2-896a-e33eb91e4410 service nova] Creating event network-vif-plugged:d676d231-6c3e-427a-83f1-caab25925cd6 for instance a23c573c-7547-4739-bf72-ad8fa8fab7ed on user Apr 17 10:50:31 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-757ece74-10db-44b4-b672-113f55fb7e42 req-a77e6c47-5257-40b2-896a-e33eb91e4410 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.036401 Apr 17 10:50:31 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 232/687] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:50:30 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:50:31 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-6275cecc-11b9-45a9-8964-700436974cae req-3f3a74a9-d31d-479f-8615-831fec702c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a23c573c-7547-4739-bf72-ad8fa8fab7ed", "name": "network-vif-deleted", "tag": "d676d231-6c3e-427a-83f1-caab25925cd6"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:50:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-6275cecc-11b9-45a9-8964-700436974cae req-3f3a74a9-d31d-479f-8615-831fec702c4f service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-6275cecc-11b9-45a9-8964-700436974cae req-3f3a74a9-d31d-479f-8615-831fec702c4f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-6275cecc-11b9-45a9-8964-700436974cae req-3f3a74a9-d31d-479f-8615-831fec702c4f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:31 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-6275cecc-11b9-45a9-8964-700436974cae req-3f3a74a9-d31d-479f-8615-831fec702c4f service nova] Creating event network-vif-deleted:d676d231-6c3e-427a-83f1-caab25925cd6 for instance a23c573c-7547-4739-bf72-ad8fa8fab7ed on user Apr 17 10:50:31 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-6275cecc-11b9-45a9-8964-700436974cae req-3f3a74a9-d31d-479f-8615-831fec702c4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085550 Apr 17 10:50:31 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 219/688] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:50:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:50:32 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-5300fca3-8983-4d47-b45b-ecb0b3dff22c tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:50:32 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-5300fca3-8983-4d47-b45b-ecb0b3dff22c tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:50:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5300fca3-8983-4d47-b45b-ecb0b3dff22c tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5300fca3-8983-4d47-b45b-ecb0b3dff22c tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5300fca3-8983-4d47-b45b-ecb0b3dff22c tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5300fca3-8983-4d47-b45b-ecb0b3dff22c tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5300fca3-8983-4d47-b45b-ecb0b3dff22c tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5300fca3-8983-4d47-b45b-ecb0b3dff22c tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:32 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-ee7889b9-2222-4ebc-9523-61535f172745 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:50:32 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-ee7889b9-2222-4ebc-9523-61535f172745 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:50:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ee7889b9-2222-4ebc-9523-61535f172745 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ee7889b9-2222-4ebc-9523-61535f172745 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ee7889b9-2222-4ebc-9523-61535f172745 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ee7889b9-2222-4ebc-9523-61535f172745 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ee7889b9-2222-4ebc-9523-61535f172745 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ee7889b9-2222-4ebc-9523-61535f172745 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:32 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-ee7889b9-2222-4ebc-9523-61535f172745 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e198ad00-927f-45e1-9f14-828d56ce3393/action" status: 202 len: 0 microversion: 2.87 time: 0.076951 Apr 17 10:50:32 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 233/689] 10.0.0.210 () {66 vars in 1396 bytes} [Mon Apr 17 10:50:32 2023] POST /compute/v2.1/servers/e198ad00-927f-45e1-9f14-828d56ce3393/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:50:32 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-855faabe-33e3-4e16-bb5b-41502a315ef7 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:50:32 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-855faabe-33e3-4e16-bb5b-41502a315ef7 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:50:32 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-855faabe-33e3-4e16-bb5b-41502a315ef7 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:32 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-855faabe-33e3-4e16-bb5b-41502a315ef7 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:32 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-855faabe-33e3-4e16-bb5b-41502a315ef7 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:32 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-855faabe-33e3-4e16-bb5b-41502a315ef7 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:32 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-855faabe-33e3-4e16-bb5b-41502a315ef7 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:32 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-855faabe-33e3-4e16-bb5b-41502a315ef7 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:32 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-5300fca3-8983-4d47-b45b-ecb0b3dff22c tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df693038f49145b9854ae18d246dde2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455ea6870abe450ba413ffabf4d4097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:50:32 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-5300fca3-8983-4d47-b45b-ecb0b3dff22c tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315" status: 200 len: 1535 microversion: 2.1 time: 0.231391 Apr 17 10:50:32 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 238/690] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:50:32 2023] GET /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315 => generated 1535 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:50:32 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-0d5f71f6-9c89-408c-9411-8e27dfc2c787 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:50:32 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-0d5f71f6-9c89-408c-9411-8e27dfc2c787 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'df693038f49145b9854ae18d246dde2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455ea6870abe450ba413ffabf4d4097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:50:32 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-0d5f71f6-9c89-408c-9411-8e27dfc2c787 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Searching by: {'deleted': False, 'project_id': '455ea6870abe450ba413ffabf4d4097e'} {{(pid=72743) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 17 10:50:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-0d5f71f6-9c89-408c-9411-8e27dfc2c787 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-0d5f71f6-9c89-408c-9411-8e27dfc2c787 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-0d5f71f6-9c89-408c-9411-8e27dfc2c787 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-0d5f71f6-9c89-408c-9411-8e27dfc2c787 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-0d5f71f6-9c89-408c-9411-8e27dfc2c787 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-0d5f71f6-9c89-408c-9411-8e27dfc2c787 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:32 user devstack@n-api.service[72743]: DEBUG nova.compute.multi_cell_list [None req-0d5f71f6-9c89-408c-9411-8e27dfc2c787 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=72743) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 17 10:50:32 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-0d5f71f6-9c89-408c-9411-8e27dfc2c787 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.174297 Apr 17 10:50:32 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 234/691] 10.0.0.210 () {62 vars in 1202 bytes} [Mon Apr 17 10:50:32 2023] GET /compute/v2.1/servers => generated 341 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:50:32 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-a481fb0c-9eec-4471-8fc0-af0993a3e85e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:50:32 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-a481fb0c-9eec-4471-8fc0-af0993a3e85e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:50:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a481fb0c-9eec-4471-8fc0-af0993a3e85e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a481fb0c-9eec-4471-8fc0-af0993a3e85e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a481fb0c-9eec-4471-8fc0-af0993a3e85e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a481fb0c-9eec-4471-8fc0-af0993a3e85e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a481fb0c-9eec-4471-8fc0-af0993a3e85e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a481fb0c-9eec-4471-8fc0-af0993a3e85e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:32 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-a481fb0c-9eec-4471-8fc0-af0993a3e85e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df693038f49145b9854ae18d246dde2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455ea6870abe450ba413ffabf4d4097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:50:32 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-a481fb0c-9eec-4471-8fc0-af0993a3e85e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315" status: 200 len: 1535 microversion: 2.1 time: 0.156389 Apr 17 10:50:32 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 239/692] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:50:32 2023] GET /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315 => generated 1535 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:50:32 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-855faabe-33e3-4e16-bb5b-41502a315ef7 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:50:32 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-855faabe-33e3-4e16-bb5b-41502a315ef7 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:50:32 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-855faabe-33e3-4e16-bb5b-41502a315ef7 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:50:32 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-855faabe-33e3-4e16-bb5b-41502a315ef7 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e198ad00-927f-45e1-9f14-828d56ce3393" status: 200 len: 1763 microversion: 2.87 time: 0.599996 Apr 17 10:50:32 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 220/693] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:50:32 2023] GET /compute/v2.1/servers/e198ad00-927f-45e1-9f14-828d56ce3393 => generated 1763 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:50:33 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-fb1244f5-e5c2-4bbc-8809-e5e704186005 req-aad151bc-9c7c-44a5-a6b8-6984c5838ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e198ad00-927f-45e1-9f14-828d56ce3393", "name": "network-vif-unplugged", "status": "completed", "tag": "8b03fa35-eaab-40ea-a06b-afa4bd410981"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:50:33 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-fb1244f5-e5c2-4bbc-8809-e5e704186005 req-aad151bc-9c7c-44a5-a6b8-6984c5838ef3 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:33 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-fb1244f5-e5c2-4bbc-8809-e5e704186005 req-aad151bc-9c7c-44a5-a6b8-6984c5838ef3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:33 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-fb1244f5-e5c2-4bbc-8809-e5e704186005 req-aad151bc-9c7c-44a5-a6b8-6984c5838ef3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:33 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-fb1244f5-e5c2-4bbc-8809-e5e704186005 req-aad151bc-9c7c-44a5-a6b8-6984c5838ef3 service nova] Creating event network-vif-unplugged:8b03fa35-eaab-40ea-a06b-afa4bd410981 for instance e198ad00-927f-45e1-9f14-828d56ce3393 on user Apr 17 10:50:33 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-fb1244f5-e5c2-4bbc-8809-e5e704186005 req-aad151bc-9c7c-44a5-a6b8-6984c5838ef3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034338 Apr 17 10:50:33 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 235/694] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:50:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:50:35 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f4bbb72-51fe-46f3-a970-cb6f934f63f3"}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:50:35 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:50:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:35 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-6545c7ac-a05a-4080-9667-51e4c18b1b99 req-61018ee6-efb1-4824-bfee-5a187b1ba4b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e198ad00-927f-45e1-9f14-828d56ce3393", "name": "network-vif-plugged", "status": "completed", "tag": "8b03fa35-eaab-40ea-a06b-afa4bd410981"}, {"server_uuid": "e198ad00-927f-45e1-9f14-828d56ce3393", "name": "network-vif-plugged", "status": "completed", "tag": "8b03fa35-eaab-40ea-a06b-afa4bd410981"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:50:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-6545c7ac-a05a-4080-9667-51e4c18b1b99 req-61018ee6-efb1-4824-bfee-5a187b1ba4b2 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-6545c7ac-a05a-4080-9667-51e4c18b1b99 req-61018ee6-efb1-4824-bfee-5a187b1ba4b2 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-6545c7ac-a05a-4080-9667-51e4c18b1b99 req-61018ee6-efb1-4824-bfee-5a187b1ba4b2 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:35 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-6545c7ac-a05a-4080-9667-51e4c18b1b99 req-61018ee6-efb1-4824-bfee-5a187b1ba4b2 service nova] Creating event network-vif-plugged:8b03fa35-eaab-40ea-a06b-afa4bd410981 for instance e198ad00-927f-45e1-9f14-828d56ce3393 on user Apr 17 10:50:35 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-6545c7ac-a05a-4080-9667-51e4c18b1b99 req-61018ee6-efb1-4824-bfee-5a187b1ba4b2 service nova] Creating event network-vif-plugged:8b03fa35-eaab-40ea-a06b-afa4bd410981 for instance e198ad00-927f-45e1-9f14-828d56ce3393 on user Apr 17 10:50:35 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-6545c7ac-a05a-4080-9667-51e4c18b1b99 req-61018ee6-efb1-4824-bfee-5a187b1ba4b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037999 Apr 17 10:50:35 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 221/695] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:50:35 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:50:35 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-86c9694e-36c9-4ab0-bfa4-0736f633d8f0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.356338 Apr 17 10:50:35 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 240/696] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Apr 17 10:50:35 2023] POST /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315/os-volume_attachments => generated 194 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 10:50:36 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-f41a74f4-e773-411f-899e-23db79942cc6 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:50:36 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-f41a74f4-e773-411f-899e-23db79942cc6 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:50:36 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f41a74f4-e773-411f-899e-23db79942cc6 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:36 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f41a74f4-e773-411f-899e-23db79942cc6 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:36 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f41a74f4-e773-411f-899e-23db79942cc6 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:36 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f41a74f4-e773-411f-899e-23db79942cc6 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:36 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f41a74f4-e773-411f-899e-23db79942cc6 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:36 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f41a74f4-e773-411f-899e-23db79942cc6 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:36 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-f41a74f4-e773-411f-899e-23db79942cc6 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad2b6b478547e78e2cf273ef0390ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652f9a7f20954e23b143e349c538f418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:50:36 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-f41a74f4-e773-411f-899e-23db79942cc6 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7fabb8d9-4062-418a-b890-48c4b45cf9cf" status: 200 len: 1496 microversion: 2.1 time: 0.325017 Apr 17 10:50:36 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 236/697] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:50:36 2023] GET /compute/v2.1/servers/7fabb8d9-4062-418a-b890-48c4b45cf9cf => generated 1496 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:50:37 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-3edf8b86-a55a-4b8e-a0a6-a287301b7a47 req-157823e4-978a-4eca-bef6-a20fd830b273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e198ad00-927f-45e1-9f14-828d56ce3393", "name": "network-vif-plugged", "status": "completed", "tag": "8b03fa35-eaab-40ea-a06b-afa4bd410981"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:50:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-3edf8b86-a55a-4b8e-a0a6-a287301b7a47 req-157823e4-978a-4eca-bef6-a20fd830b273 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-3edf8b86-a55a-4b8e-a0a6-a287301b7a47 req-157823e4-978a-4eca-bef6-a20fd830b273 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-3edf8b86-a55a-4b8e-a0a6-a287301b7a47 req-157823e4-978a-4eca-bef6-a20fd830b273 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:37 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-3edf8b86-a55a-4b8e-a0a6-a287301b7a47 req-157823e4-978a-4eca-bef6-a20fd830b273 service nova] Creating event network-vif-plugged:8b03fa35-eaab-40ea-a06b-afa4bd410981 for instance e198ad00-927f-45e1-9f14-828d56ce3393 on user Apr 17 10:50:37 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-3edf8b86-a55a-4b8e-a0a6-a287301b7a47 req-157823e4-978a-4eca-bef6-a20fd830b273 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033148 Apr 17 10:50:37 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 222/698] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:50:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:50:48 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=10 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:50:48 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:50:48 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-57100ec9-d591-4794-8d68-ed4705c09000 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:50:48 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-57100ec9-d591-4794-8d68-ed4705c09000 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:50:48 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-57100ec9-d591-4794-8d68-ed4705c09000 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:48 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-57100ec9-d591-4794-8d68-ed4705c09000 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:48 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-57100ec9-d591-4794-8d68-ed4705c09000 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:48 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-57100ec9-d591-4794-8d68-ed4705c09000 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:48 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-57100ec9-d591-4794-8d68-ed4705c09000 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:48 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-57100ec9-d591-4794-8d68-ed4705c09000 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:48 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-57100ec9-d591-4794-8d68-ed4705c09000 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df693038f49145b9854ae18d246dde2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455ea6870abe450ba413ffabf4d4097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:50:48 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-57100ec9-d591-4794-8d68-ed4705c09000 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315" status: 200 len: 1581 microversion: 2.1 time: 0.527533 Apr 17 10:50:48 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 241/699] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:50:48 2023] GET /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315 => generated 1581 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:50:51 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-8f10789a-1219-4ff3-aaef-f9d656126690 req-b46321d7-5327-4aab-98d8-81c91147f2fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fd89020-5492-4e40-a911-63f9b1b43315", "tag": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:50:51 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:50:51 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:50:51 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:50:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-8f10789a-1219-4ff3-aaef-f9d656126690 req-b46321d7-5327-4aab-98d8-81c91147f2fa service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-8f10789a-1219-4ff3-aaef-f9d656126690 req-b46321d7-5327-4aab-98d8-81c91147f2fa service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-8f10789a-1219-4ff3-aaef-f9d656126690 req-b46321d7-5327-4aab-98d8-81c91147f2fa service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:51 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-8f10789a-1219-4ff3-aaef-f9d656126690 req-b46321d7-5327-4aab-98d8-81c91147f2fa service nova] Creating event network-changed:65f23819-ccfb-4eb0-adc1-3f9895ed9c39 for instance 3fd89020-5492-4e40-a911-63f9b1b43315 on user Apr 17 10:50:51 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-8f10789a-1219-4ff3-aaef-f9d656126690 req-b46321d7-5327-4aab-98d8-81c91147f2fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036579 Apr 17 10:50:51 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 237/700] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:50:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:50:52 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=12 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:50:52 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=14 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:50:52 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-cf2ea3ef-1d5c-40de-b8ff-d1c977c5b08c tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-182384916"}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:50:52 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-cf2ea3ef-1d5c-40de-b8ff-d1c977c5b08c tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:50:52 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cf2ea3ef-1d5c-40de-b8ff-d1c977c5b08c tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:52 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cf2ea3ef-1d5c-40de-b8ff-d1c977c5b08c tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:52 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cf2ea3ef-1d5c-40de-b8ff-d1c977c5b08c tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:52 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cf2ea3ef-1d5c-40de-b8ff-d1c977c5b08c tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:52 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cf2ea3ef-1d5c-40de-b8ff-d1c977c5b08c tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:52 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cf2ea3ef-1d5c-40de-b8ff-d1c977c5b08c tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:53 user devstack@n-api.service[72744]: INFO nova.network.security_group_api [None req-cf2ea3ef-1d5c-40de-b8ff-d1c977c5b08c tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Adding security group c07f8d40-7da6-49a4-af77-6bbda9efa653 to port 65f23819-ccfb-4eb0-adc1-3f9895ed9c39 Apr 17 10:50:53 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-cf2ea3ef-1d5c-40de-b8ff-d1c977c5b08c tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315/action" status: 202 len: 0 microversion: 2.1 time: 0.631584 Apr 17 10:50:53 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 223/701] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 10:50:52 2023] POST /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315/action => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:50:53 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-2f29071f-a32a-41ff-8f95-7a2d5ae525eb req-cb5ffe04-bb80-41a9-9c6f-4dba53fcafe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fd89020-5492-4e40-a911-63f9b1b43315", "tag": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:50:53 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-015f2cf4-e66f-4801-91e1-a75df23f2fc2 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:50:53 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-015f2cf4-e66f-4801-91e1-a75df23f2fc2 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:50:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-015f2cf4-e66f-4801-91e1-a75df23f2fc2 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-015f2cf4-e66f-4801-91e1-a75df23f2fc2 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-015f2cf4-e66f-4801-91e1-a75df23f2fc2 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-015f2cf4-e66f-4801-91e1-a75df23f2fc2 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:53 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-2f29071f-a32a-41ff-8f95-7a2d5ae525eb req-cb5ffe04-bb80-41a9-9c6f-4dba53fcafe6 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-015f2cf4-e66f-4801-91e1-a75df23f2fc2 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-015f2cf4-e66f-4801-91e1-a75df23f2fc2 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:53 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-2f29071f-a32a-41ff-8f95-7a2d5ae525eb req-cb5ffe04-bb80-41a9-9c6f-4dba53fcafe6 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:53 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-2f29071f-a32a-41ff-8f95-7a2d5ae525eb req-cb5ffe04-bb80-41a9-9c6f-4dba53fcafe6 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:53 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-2f29071f-a32a-41ff-8f95-7a2d5ae525eb req-cb5ffe04-bb80-41a9-9c6f-4dba53fcafe6 service nova] Creating event network-changed:65f23819-ccfb-4eb0-adc1-3f9895ed9c39 for instance 3fd89020-5492-4e40-a911-63f9b1b43315 on user Apr 17 10:50:53 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-2f29071f-a32a-41ff-8f95-7a2d5ae525eb req-cb5ffe04-bb80-41a9-9c6f-4dba53fcafe6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037029 Apr 17 10:50:53 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 242/702] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:50:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:50:53 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-015f2cf4-e66f-4801-91e1-a75df23f2fc2 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df693038f49145b9854ae18d246dde2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455ea6870abe450ba413ffabf4d4097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:50:53 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-015f2cf4-e66f-4801-91e1-a75df23f2fc2 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315" status: 200 len: 1746 microversion: 2.1 time: 0.250976 Apr 17 10:50:53 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 238/703] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:50:53 2023] GET /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315 => generated 1746 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:50:57 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:50:57 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:50:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:57 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-9a14ccfb-533a-40fa-85d7-a1c1f3c3be2e tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315/action" status: 202 len: 0 microversion: 2.1 time: 0.083953 Apr 17 10:50:57 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 224/704] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 10:50:57 2023] POST /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:50:57 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-4d79ef01-a968-4111-9bf2-105c44e4db38 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:50:57 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-4d79ef01-a968-4111-9bf2-105c44e4db38 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:50:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4d79ef01-a968-4111-9bf2-105c44e4db38 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4d79ef01-a968-4111-9bf2-105c44e4db38 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4d79ef01-a968-4111-9bf2-105c44e4db38 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4d79ef01-a968-4111-9bf2-105c44e4db38 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4d79ef01-a968-4111-9bf2-105c44e4db38 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4d79ef01-a968-4111-9bf2-105c44e4db38 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:57 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-4d79ef01-a968-4111-9bf2-105c44e4db38 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df693038f49145b9854ae18d246dde2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455ea6870abe450ba413ffabf4d4097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:50:57 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-4d79ef01-a968-4111-9bf2-105c44e4db38 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315" status: 200 len: 1748 microversion: 2.1 time: 0.680955 Apr 17 10:50:57 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 243/705] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:50:57 2023] GET /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315 => generated 1748 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:50:58 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-662d62c8-6a4e-4236-a75b-62493c2129a8 req-ad42e157-ec2b-446b-9dac-89222c4bd728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd89020-5492-4e40-a911-63f9b1b43315", "name": "network-vif-unplugged", "status": "completed", "tag": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:50:58 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-662d62c8-6a4e-4236-a75b-62493c2129a8 req-ad42e157-ec2b-446b-9dac-89222c4bd728 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:58 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-662d62c8-6a4e-4236-a75b-62493c2129a8 req-ad42e157-ec2b-446b-9dac-89222c4bd728 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:58 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-662d62c8-6a4e-4236-a75b-62493c2129a8 req-ad42e157-ec2b-446b-9dac-89222c4bd728 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:58 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-662d62c8-6a4e-4236-a75b-62493c2129a8 req-ad42e157-ec2b-446b-9dac-89222c4bd728 service nova] Creating event network-vif-unplugged:65f23819-ccfb-4eb0-adc1-3f9895ed9c39 for instance 3fd89020-5492-4e40-a911-63f9b1b43315 on user Apr 17 10:50:58 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-662d62c8-6a4e-4236-a75b-62493c2129a8 req-ad42e157-ec2b-446b-9dac-89222c4bd728 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032830 Apr 17 10:50:58 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 239/706] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:50:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:50:58 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-492012460", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "feeaead2-197c-4dec-95ed-00c5445d0833", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b2fc1cd4-860e-4abd-8e33-e797799c466f"}]}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:50:58 user devstack@n-api.service[72744]: DEBUG nova.network.neutron [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] validate_networks() for [('b2fc1cd4-860e-4abd-8e33-e797799c466f', None, None, None, None, None)] {{(pid=72744) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:50:59 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flavor limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:50:59 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Image limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:50:59 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flavor pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:50:59 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Image pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:50:59 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:50:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:50:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:50:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:50:59 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Getting quotas for project 4fc3b8e3925847d48b522206a8875d3f. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:50:59 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Getting quotas for user 0e4ed1192974484bba2d4392f4d011c2 and project 4fc3b8e3925847d48b522206a8875d3f. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:50:59 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Going to run 1 instances... {{(pid=72744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:50:59 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='feeaead2-197c-4dec-95ed-00c5445d0833',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:50:59 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-aa79f866-fa9f-4513-969d-ee792e6afef0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.642588 Apr 17 10:50:59 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 225/707] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:50:58 2023] POST /compute/v2.1/servers => generated 378 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 10:50:59 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-6ddf3495-cb99-4a8e-8641-275bc9ea83df tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:50:59 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-6ddf3495-cb99-4a8e-8641-275bc9ea83df tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:50:59 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-6ddf3495-cb99-4a8e-8641-275bc9ea83df tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:50:59 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-6ddf3495-cb99-4a8e-8641-275bc9ea83df tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38871910-281e-4aea-9343-79aed3f3b1b9" status: 200 len: 1051 microversion: 2.1 time: 0.062947 Apr 17 10:50:59 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 244/708] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:50:59 2023] GET /compute/v2.1/servers/38871910-281e-4aea-9343-79aed3f3b1b9 => generated 1051 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:51:00 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-876c9b96-fd53-445f-a013-a6aacb5e4e50 req-b0b23582-89ae-4c6e-b052-54292dba278a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd89020-5492-4e40-a911-63f9b1b43315", "name": "network-vif-plugged", "status": "completed", "tag": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:51:00 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-876c9b96-fd53-445f-a013-a6aacb5e4e50 req-b0b23582-89ae-4c6e-b052-54292dba278a service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:00 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-876c9b96-fd53-445f-a013-a6aacb5e4e50 req-b0b23582-89ae-4c6e-b052-54292dba278a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:00 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-876c9b96-fd53-445f-a013-a6aacb5e4e50 req-b0b23582-89ae-4c6e-b052-54292dba278a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:00 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-876c9b96-fd53-445f-a013-a6aacb5e4e50 req-b0b23582-89ae-4c6e-b052-54292dba278a service nova] Creating event network-vif-plugged:65f23819-ccfb-4eb0-adc1-3f9895ed9c39 for instance 3fd89020-5492-4e40-a911-63f9b1b43315 on user Apr 17 10:51:00 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-876c9b96-fd53-445f-a013-a6aacb5e4e50 req-b0b23582-89ae-4c6e-b052-54292dba278a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033994 Apr 17 10:51:00 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 240/709] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:51:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:51:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-c17fd8e1-62fd-4546-9e5e-098b9b207542 req-cf3779e9-5d89-4285-b073-25be977adbca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38871910-281e-4aea-9343-79aed3f3b1b9", "tag": "477fa3ea-f59d-4fc6-8eb8-4cf064201e14"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:51:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-c17fd8e1-62fd-4546-9e5e-098b9b207542 req-cf3779e9-5d89-4285-b073-25be977adbca service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-c17fd8e1-62fd-4546-9e5e-098b9b207542 req-cf3779e9-5d89-4285-b073-25be977adbca service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-c17fd8e1-62fd-4546-9e5e-098b9b207542 req-cf3779e9-5d89-4285-b073-25be977adbca service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:01 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-c17fd8e1-62fd-4546-9e5e-098b9b207542 req-cf3779e9-5d89-4285-b073-25be977adbca service nova] Creating event network-changed:477fa3ea-f59d-4fc6-8eb8-4cf064201e14 for instance 38871910-281e-4aea-9343-79aed3f3b1b9 on user Apr 17 10:51:01 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-c17fd8e1-62fd-4546-9e5e-098b9b207542 req-cf3779e9-5d89-4285-b073-25be977adbca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038697 Apr 17 10:51:01 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 226/710] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:51:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:51:02 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-4821ad53-685b-445b-aba7-a2ec1cd6c785 req-3c3aa936-0ab1-4653-8890-7e1dc9ec7cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd89020-5492-4e40-a911-63f9b1b43315", "name": "network-vif-plugged", "status": "completed", "tag": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:51:02 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-4821ad53-685b-445b-aba7-a2ec1cd6c785 req-3c3aa936-0ab1-4653-8890-7e1dc9ec7cd3 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:02 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-4821ad53-685b-445b-aba7-a2ec1cd6c785 req-3c3aa936-0ab1-4653-8890-7e1dc9ec7cd3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:02 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-4821ad53-685b-445b-aba7-a2ec1cd6c785 req-3c3aa936-0ab1-4653-8890-7e1dc9ec7cd3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:02 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-4821ad53-685b-445b-aba7-a2ec1cd6c785 req-3c3aa936-0ab1-4653-8890-7e1dc9ec7cd3 service nova] Creating event network-vif-plugged:65f23819-ccfb-4eb0-adc1-3f9895ed9c39 for instance 3fd89020-5492-4e40-a911-63f9b1b43315 on user Apr 17 10:51:02 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-4821ad53-685b-445b-aba7-a2ec1cd6c785 req-3c3aa936-0ab1-4653-8890-7e1dc9ec7cd3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048783 Apr 17 10:51:02 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 245/711] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:51:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:51:04 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-d72268e6-e471-4af1-aa78-ef27247868d9 req-ccd27fcf-326c-4818-8dc4-4e0305ae0dcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd89020-5492-4e40-a911-63f9b1b43315", "name": "network-vif-plugged", "status": "completed", "tag": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:51:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-d72268e6-e471-4af1-aa78-ef27247868d9 req-ccd27fcf-326c-4818-8dc4-4e0305ae0dcf service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-d72268e6-e471-4af1-aa78-ef27247868d9 req-ccd27fcf-326c-4818-8dc4-4e0305ae0dcf service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-d72268e6-e471-4af1-aa78-ef27247868d9 req-ccd27fcf-326c-4818-8dc4-4e0305ae0dcf service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:04 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-d72268e6-e471-4af1-aa78-ef27247868d9 req-ccd27fcf-326c-4818-8dc4-4e0305ae0dcf service nova] Creating event network-vif-plugged:65f23819-ccfb-4eb0-adc1-3f9895ed9c39 for instance 3fd89020-5492-4e40-a911-63f9b1b43315 on user Apr 17 10:51:04 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-d72268e6-e471-4af1-aa78-ef27247868d9 req-ccd27fcf-326c-4818-8dc4-4e0305ae0dcf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028787 Apr 17 10:51:04 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 241/712] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:51:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 10:51:12 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:51:12 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:51:12 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:51:12 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:51:12 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-455ab17e-5217-4fc7-8f98-60b00b2570bc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:51:12 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-455ab17e-5217-4fc7-8f98-60b00b2570bc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:51:12 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-455ab17e-5217-4fc7-8f98-60b00b2570bc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:12 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-455ab17e-5217-4fc7-8f98-60b00b2570bc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:12 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-455ab17e-5217-4fc7-8f98-60b00b2570bc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:12 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-455ab17e-5217-4fc7-8f98-60b00b2570bc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:12 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-455ab17e-5217-4fc7-8f98-60b00b2570bc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:12 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-455ab17e-5217-4fc7-8f98-60b00b2570bc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:13 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-455ab17e-5217-4fc7-8f98-60b00b2570bc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:51:13 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-455ab17e-5217-4fc7-8f98-60b00b2570bc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 200 len: 1721 microversion: 2.1 time: 0.631779 Apr 17 10:51:13 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 227/713] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:51:12 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 1721 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:51:13 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:51:13 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=12 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:51:13 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=16 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:51:13 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-7b58e7c2-bf29-4c1d-9921-70694932687e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:51:13 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-7b58e7c2-bf29-4c1d-9921-70694932687e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:51:13 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7b58e7c2-bf29-4c1d-9921-70694932687e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:13 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7b58e7c2-bf29-4c1d-9921-70694932687e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:13 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7b58e7c2-bf29-4c1d-9921-70694932687e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:13 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7b58e7c2-bf29-4c1d-9921-70694932687e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:13 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7b58e7c2-bf29-4c1d-9921-70694932687e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:13 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7b58e7c2-bf29-4c1d-9921-70694932687e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:13 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-7b58e7c2-bf29-4c1d-9921-70694932687e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:51:13 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-7b58e7c2-bf29-4c1d-9921-70694932687e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 200 len: 1721 microversion: 2.1 time: 0.309973 Apr 17 10:51:13 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 246/714] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:51:13 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 1721 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:51:13 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-b53dda15-a9da-459f-bfac-f0bdc0665a8a req-f27d1855-41c8-4faa-9ad0-9890f0213ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38871910-281e-4aea-9343-79aed3f3b1b9", "name": "network-vif-plugged", "status": "completed", "tag": "477fa3ea-f59d-4fc6-8eb8-4cf064201e14"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:51:13 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-b53dda15-a9da-459f-bfac-f0bdc0665a8a req-f27d1855-41c8-4faa-9ad0-9890f0213ee3 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:13 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-b53dda15-a9da-459f-bfac-f0bdc0665a8a req-f27d1855-41c8-4faa-9ad0-9890f0213ee3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:13 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-b53dda15-a9da-459f-bfac-f0bdc0665a8a req-f27d1855-41c8-4faa-9ad0-9890f0213ee3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:13 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-b53dda15-a9da-459f-bfac-f0bdc0665a8a req-f27d1855-41c8-4faa-9ad0-9890f0213ee3 service nova] Creating event network-vif-plugged:477fa3ea-f59d-4fc6-8eb8-4cf064201e14 for instance 38871910-281e-4aea-9343-79aed3f3b1b9 on user Apr 17 10:51:13 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-b53dda15-a9da-459f-bfac-f0bdc0665a8a req-f27d1855-41c8-4faa-9ad0-9890f0213ee3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045718 Apr 17 10:51:13 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 242/715] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:51:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:51:15 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-bf37ef3e-bbe6-4f26-8764-a663a9808838 req-ac5c845f-2907-4b11-b3f4-eb1e2dd7d4ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38871910-281e-4aea-9343-79aed3f3b1b9", "name": "network-vif-plugged", "status": "completed", "tag": "477fa3ea-f59d-4fc6-8eb8-4cf064201e14"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:51:15 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-bf37ef3e-bbe6-4f26-8764-a663a9808838 req-ac5c845f-2907-4b11-b3f4-eb1e2dd7d4ac service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:15 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-bf37ef3e-bbe6-4f26-8764-a663a9808838 req-ac5c845f-2907-4b11-b3f4-eb1e2dd7d4ac service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:15 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-bf37ef3e-bbe6-4f26-8764-a663a9808838 req-ac5c845f-2907-4b11-b3f4-eb1e2dd7d4ac service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:16 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-bf37ef3e-bbe6-4f26-8764-a663a9808838 req-ac5c845f-2907-4b11-b3f4-eb1e2dd7d4ac service nova] Creating event network-vif-plugged:477fa3ea-f59d-4fc6-8eb8-4cf064201e14 for instance 38871910-281e-4aea-9343-79aed3f3b1b9 on user Apr 17 10:51:16 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-bf37ef3e-bbe6-4f26-8764-a663a9808838 req-ac5c845f-2907-4b11-b3f4-eb1e2dd7d4ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031148 Apr 17 10:51:16 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 228/716] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:51:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:51:19 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-f3178e88-2a96-4cd2-bbc4-34d985ac3688 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:51:19 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-f3178e88-2a96-4cd2-bbc4-34d985ac3688 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: a23c573c-7547-4739-bf72-ad8fa8fab7ed] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:51:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f3178e88-2a96-4cd2-bbc4-34d985ac3688 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f3178e88-2a96-4cd2-bbc4-34d985ac3688 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f3178e88-2a96-4cd2-bbc4-34d985ac3688 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f3178e88-2a96-4cd2-bbc4-34d985ac3688 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f3178e88-2a96-4cd2-bbc4-34d985ac3688 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f3178e88-2a96-4cd2-bbc4-34d985ac3688 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:19 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-f3178e88-2a96-4cd2-bbc4-34d985ac3688 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] HTTP exception thrown: Instance a23c573c-7547-4739-bf72-ad8fa8fab7ed could not be found. Apr 17 10:51:19 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-f3178e88-2a96-4cd2-bbc4-34d985ac3688 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Request method failure captured: Apr 17 10:51:19 user devstack@n-api.service[72745]: request: GET /compute/v2.1/servers/a23c573c-7547-4739-bf72-ad8fa8fab7ed HTTP/1.1 Apr 17 10:51:19 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:51:19 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:51:19 user devstack@n-api.service[72745]: Connection: close Apr 17 10:51:19 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 10:51:19 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:51:19 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:51:19 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:51:19 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:51:19 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSMAQ6pXdTDNWnNt-XWgQj7MYkWlDd-UyN_F40GWGPmxdEcy4U1rIyN_vggYNXfAYIr7lqck09FHQbeJTqAvadkEFBmqkneKZKB11tC3Y9RkWp7uooEvuYyOfWAO237XmEqRuF1lmmUsjmXaokl5CVtD2qkjP1B_jo3Sd47i1feJnzA Apr 17 10:51:19 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:51:19 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:51:19 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:51:19 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:51:19 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:51:19 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:51:19 user devstack@n-api.service[72745]: X-Project-Id: 84cd384dfcbb4739b9694704c1fad001 Apr 17 10:51:19 user devstack@n-api.service[72745]: X-Project-Name: tempest-TestStampPattern-2056640667 Apr 17 10:51:19 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:51:19 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:51:19 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/84cd384dfcbb4739b9694704c1fad001"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/84cd384dfcbb4739b9694704c1fad001"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/84cd384dfcbb4739b9694704c1fad001"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:51:19 user devstack@n-api.service[72745]: X-Tenant: tempest-TestStampPattern-2056640667 Apr 17 10:51:19 user devstack@n-api.service[72745]: X-Tenant-Id: 84cd384dfcbb4739b9694704c1fad001 Apr 17 10:51:19 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-TestStampPattern-2056640667 Apr 17 10:51:19 user devstack@n-api.service[72745]: X-User: tempest-TestStampPattern-2056640667-project-member Apr 17 10:51:19 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:51:19 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:51:19 user devstack@n-api.service[72745]: X-User-Id: 708740584a3d488da0ee13e5f8299b7f Apr 17 10:51:19 user devstack@n-api.service[72745]: X-User-Name: tempest-TestStampPattern-2056640667-project-member Apr 17 10:51:19 user devstack@n-api.service[72745]: method: > Apr 17 10:51:19 user devstack@n-api.service[72745]: exception: Instance a23c573c-7547-4739-bf72-ad8fa8fab7ed could not be found. Apr 17 10:51:19 user devstack@n-api.service[72745]: action_args: {'id': 'a23c573c-7547-4739-bf72-ad8fa8fab7ed'} Apr 17 10:51:19 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a23c573c-7547-4739-bf72-ad8fa8fab7ed could not be found. Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a23c573c-7547-4739-bf72-ad8fa8fab7ed could not be found. Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a23c573c-7547-4739-bf72-ad8fa8fab7ed could not be found. Apr 17 10:51:19 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:51:19 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-f3178e88-2a96-4cd2-bbc4-34d985ac3688 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Returning 404 to user: Instance a23c573c-7547-4739-bf72-ad8fa8fab7ed could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:51:19 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-f3178e88-2a96-4cd2-bbc4-34d985ac3688 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a23c573c-7547-4739-bf72-ad8fa8fab7ed" status: 404 len: 111 microversion: 2.1 time: 0.028807 Apr 17 10:51:19 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 247/717] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:51:19 2023] GET /compute/v2.1/servers/a23c573c-7547-4739-bf72-ad8fa8fab7ed => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:51:23 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-ab47b78c-5b41-4d26-94e6-880319f0299c tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:51:23 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-ab47b78c-5b41-4d26-94e6-880319f0299c tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:51:23 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=13 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:51:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ab47b78c-5b41-4d26-94e6-880319f0299c tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ab47b78c-5b41-4d26-94e6-880319f0299c tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ab47b78c-5b41-4d26-94e6-880319f0299c tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ab47b78c-5b41-4d26-94e6-880319f0299c tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ab47b78c-5b41-4d26-94e6-880319f0299c tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ab47b78c-5b41-4d26-94e6-880319f0299c tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:23 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=17 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:51:23 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-ab47b78c-5b41-4d26-94e6-880319f0299c tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:51:23 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-ab47b78c-5b41-4d26-94e6-880319f0299c tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:51:23 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-ab47b78c-5b41-4d26-94e6-880319f0299c tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:51:23 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-ab47b78c-5b41-4d26-94e6-880319f0299c tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e198ad00-927f-45e1-9f14-828d56ce3393" status: 200 len: 1769 microversion: 2.87 time: 0.438764 Apr 17 10:51:23 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 243/718] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:51:22 2023] GET /compute/v2.1/servers/e198ad00-927f-45e1-9f14-828d56ce3393 => generated 1769 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:51:26 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=4 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:51:26 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=8 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:51:26 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-38eae9cf-5b54-4010-bd58-6678e3224a8c tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:51:26 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-38eae9cf-5b54-4010-bd58-6678e3224a8c tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:51:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-38eae9cf-5b54-4010-bd58-6678e3224a8c tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-38eae9cf-5b54-4010-bd58-6678e3224a8c tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-38eae9cf-5b54-4010-bd58-6678e3224a8c tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-38eae9cf-5b54-4010-bd58-6678e3224a8c tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-38eae9cf-5b54-4010-bd58-6678e3224a8c tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-38eae9cf-5b54-4010-bd58-6678e3224a8c tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:26 user devstack@n-api.service[72744]: INFO nova.api.openstack.wsgi [None req-38eae9cf-5b54-4010-bd58-6678e3224a8c tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] HTTP exception thrown: Instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 is not attached to volume 7668fb8a-411e-4774-87c2-7029f4aa44ae Apr 17 10:51:26 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-38eae9cf-5b54-4010-bd58-6678e3224a8c tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Request method failure captured: Apr 17 10:51:26 user devstack@n-api.service[72744]: request: DELETE /compute/v2.1/servers/d61e9333-fe01-4a9e-abab-ef31ba6d4173/os-volume_attachments/7668fb8a-411e-4774-87c2-7029f4aa44ae HTTP/1.1 Apr 17 10:51:26 user devstack@n-api.service[72744]: Accept: application/json Apr 17 10:51:26 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 10:51:26 user devstack@n-api.service[72744]: Connection: close Apr 17 10:51:26 user devstack@n-api.service[72744]: Content-Length: 0 Apr 17 10:51:26 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 10:51:26 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 10:51:26 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 10:51:26 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 10:51:26 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSMAQ6pXdTDNWnNt-XWgQj7MYkWlDd-UyN_F40GWGPmxdEcy4U1rIyN_vggYNXfAYIr7lqck09FHQbeJTqAvadkEFBmqkneKZKB11tC3Y9RkWp7uooEvuYyOfWAO237XmEqRuF1lmmUsjmXaokl5CVtD2qkjP1B_jo3Sd47i1feJnzA Apr 17 10:51:26 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 10:51:26 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 10:51:26 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 10:51:26 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 10:51:26 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 10:51:26 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 10:51:26 user devstack@n-api.service[72744]: X-Project-Id: 84cd384dfcbb4739b9694704c1fad001 Apr 17 10:51:26 user devstack@n-api.service[72744]: X-Project-Name: tempest-TestStampPattern-2056640667 Apr 17 10:51:26 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 10:51:26 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 10:51:26 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/84cd384dfcbb4739b9694704c1fad001"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/84cd384dfcbb4739b9694704c1fad001"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/84cd384dfcbb4739b9694704c1fad001"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:51:26 user devstack@n-api.service[72744]: X-Tenant: tempest-TestStampPattern-2056640667 Apr 17 10:51:26 user devstack@n-api.service[72744]: X-Tenant-Id: 84cd384dfcbb4739b9694704c1fad001 Apr 17 10:51:26 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-TestStampPattern-2056640667 Apr 17 10:51:26 user devstack@n-api.service[72744]: X-User: tempest-TestStampPattern-2056640667-project-member Apr 17 10:51:26 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 10:51:26 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 10:51:26 user devstack@n-api.service[72744]: X-User-Id: 708740584a3d488da0ee13e5f8299b7f Apr 17 10:51:26 user devstack@n-api.service[72744]: X-User-Name: tempest-TestStampPattern-2056640667-project-member Apr 17 10:51:26 user devstack@n-api.service[72744]: method: > Apr 17 10:51:26 user devstack@n-api.service[72744]: exception: Instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 is not attached to volume 7668fb8a-411e-4774-87c2-7029f4aa44ae Apr 17 10:51:26 user devstack@n-api.service[72744]: action_args: {'server_id': 'd61e9333-fe01-4a9e-abab-ef31ba6d4173', 'id': '7668fb8a-411e-4774-87c2-7029f4aa44ae'} Apr 17 10:51:26 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7668fb8a-411e-4774-87c2-7029f4aa44ae. Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 is not attached to volume 7668fb8a-411e-4774-87c2-7029f4aa44ae Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 is not attached to volume 7668fb8a-411e-4774-87c2-7029f4aa44ae Apr 17 10:51:26 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:51:26 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-38eae9cf-5b54-4010-bd58-6678e3224a8c tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Returning 404 to user: Instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 is not attached to volume 7668fb8a-411e-4774-87c2-7029f4aa44ae {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:51:26 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-38eae9cf-5b54-4010-bd58-6678e3224a8c tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d61e9333-fe01-4a9e-abab-ef31ba6d4173/os-volume_attachments/7668fb8a-411e-4774-87c2-7029f4aa44ae" status: 404 len: 154 microversion: 2.1 time: 0.090771 Apr 17 10:51:26 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 229/719] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Apr 17 10:51:26 2023] DELETE /compute/v2.1/servers/d61e9333-fe01-4a9e-abab-ef31ba6d4173/os-volume_attachments/7668fb8a-411e-4774-87c2-7029f4aa44ae => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:51:26 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:51:26 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:51:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:26 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Going to try to terminate instance {{(pid=72745) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:51:26 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-4b57a10a-9fc5-4c1b-be53-e7a6433e52ab req-831b9421-cb51-4490-b95b-6e3d294d26f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d61e9333-fe01-4a9e-abab-ef31ba6d4173", "tag": "481e24d2-75a9-47c3-8d22-8573d260e7d3"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:51:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-4b57a10a-9fc5-4c1b-be53-e7a6433e52ab req-831b9421-cb51-4490-b95b-6e3d294d26f3 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-4b57a10a-9fc5-4c1b-be53-e7a6433e52ab req-831b9421-cb51-4490-b95b-6e3d294d26f3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-4b57a10a-9fc5-4c1b-be53-e7a6433e52ab req-831b9421-cb51-4490-b95b-6e3d294d26f3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:26 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-9cadef33-94e9-41ed-a304-7cd273eae49b tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d61e9333-fe01-4a9e-abab-ef31ba6d4173" status: 204 len: 0 microversion: 2.1 time: 0.120713 Apr 17 10:51:26 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-4b57a10a-9fc5-4c1b-be53-e7a6433e52ab req-831b9421-cb51-4490-b95b-6e3d294d26f3 service nova] Creating event network-changed:481e24d2-75a9-47c3-8d22-8573d260e7d3 for instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 on user Apr 17 10:51:26 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 248/720] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:51:26 2023] DELETE /compute/v2.1/servers/d61e9333-fe01-4a9e-abab-ef31ba6d4173 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:51:26 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-191071dd-9f65-42d4-b6ed-d2dd8c1021f6 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:51:26 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-191071dd-9f65-42d4-b6ed-d2dd8c1021f6 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:51:26 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-4b57a10a-9fc5-4c1b-be53-e7a6433e52ab req-831b9421-cb51-4490-b95b-6e3d294d26f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126732 Apr 17 10:51:26 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 244/721] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:51:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:51:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-191071dd-9f65-42d4-b6ed-d2dd8c1021f6 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-191071dd-9f65-42d4-b6ed-d2dd8c1021f6 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-191071dd-9f65-42d4-b6ed-d2dd8c1021f6 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-191071dd-9f65-42d4-b6ed-d2dd8c1021f6 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-191071dd-9f65-42d4-b6ed-d2dd8c1021f6 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-191071dd-9f65-42d4-b6ed-d2dd8c1021f6 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:27 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-191071dd-9f65-42d4-b6ed-d2dd8c1021f6 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708740584a3d488da0ee13e5f8299b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84cd384dfcbb4739b9694704c1fad001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:51:27 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-191071dd-9f65-42d4-b6ed-d2dd8c1021f6 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d61e9333-fe01-4a9e-abab-ef31ba6d4173" status: 200 len: 1661 microversion: 2.1 time: 0.432956 Apr 17 10:51:27 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 230/722] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:51:26 2023] GET /compute/v2.1/servers/d61e9333-fe01-4a9e-abab-ef31ba6d4173 => generated 1661 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:51:28 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-13d306c5-2e88-43e4-906c-724c7636376c req-84d5606d-ed3a-4700-8031-aa86215b9a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d61e9333-fe01-4a9e-abab-ef31ba6d4173", "name": "network-vif-deleted", "tag": "481e24d2-75a9-47c3-8d22-8573d260e7d3"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:51:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-13d306c5-2e88-43e4-906c-724c7636376c req-84d5606d-ed3a-4700-8031-aa86215b9a6d service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-13d306c5-2e88-43e4-906c-724c7636376c req-84d5606d-ed3a-4700-8031-aa86215b9a6d service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:28 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-13d306c5-2e88-43e4-906c-724c7636376c req-84d5606d-ed3a-4700-8031-aa86215b9a6d service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:28 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-13d306c5-2e88-43e4-906c-724c7636376c req-84d5606d-ed3a-4700-8031-aa86215b9a6d service nova] Creating event network-vif-deleted:481e24d2-75a9-47c3-8d22-8573d260e7d3 for instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 on user Apr 17 10:51:28 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-13d306c5-2e88-43e4-906c-724c7636376c req-84d5606d-ed3a-4700-8031-aa86215b9a6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033054 Apr 17 10:51:28 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 249/723] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:51:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:51:28 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-701eaa97-3b2a-475f-bfcd-879bf91fdada req-257e7ac0-8ac8-497c-911f-f919b7ecbcb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d61e9333-fe01-4a9e-abab-ef31ba6d4173", "name": "network-vif-unplugged", "status": "completed", "tag": "481e24d2-75a9-47c3-8d22-8573d260e7d3"}, {"server_uuid": "d61e9333-fe01-4a9e-abab-ef31ba6d4173", "name": "network-vif-plugged", "status": "completed", "tag": "481e24d2-75a9-47c3-8d22-8573d260e7d3"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:51:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-701eaa97-3b2a-475f-bfcd-879bf91fdada req-257e7ac0-8ac8-497c-911f-f919b7ecbcb9 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-701eaa97-3b2a-475f-bfcd-879bf91fdada req-257e7ac0-8ac8-497c-911f-f919b7ecbcb9 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-701eaa97-3b2a-475f-bfcd-879bf91fdada req-257e7ac0-8ac8-497c-911f-f919b7ecbcb9 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:28 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-701eaa97-3b2a-475f-bfcd-879bf91fdada req-257e7ac0-8ac8-497c-911f-f919b7ecbcb9 service nova] Creating event network-vif-unplugged:481e24d2-75a9-47c3-8d22-8573d260e7d3 for instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 on user Apr 17 10:51:28 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-701eaa97-3b2a-475f-bfcd-879bf91fdada req-257e7ac0-8ac8-497c-911f-f919b7ecbcb9 service nova] Creating event network-vif-plugged:481e24d2-75a9-47c3-8d22-8573d260e7d3 for instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 on user Apr 17 10:51:28 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-701eaa97-3b2a-475f-bfcd-879bf91fdada req-257e7ac0-8ac8-497c-911f-f919b7ecbcb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.049129 Apr 17 10:51:28 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 245/724] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:51:28 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:51:36 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20b74da5-efb5-4d50-9628-f5170c25ca00", "device": "/dev/vdb"}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:51:36 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:51:36 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:36 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:36 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:36 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:36 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:36 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:36 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-6ef2444a-7c46-43ae-b6e4-c2a4fc853954 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7fabb8d9-4062-418a-b890-48c4b45cf9cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268577 Apr 17 10:51:36 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 231/725] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Apr 17 10:51:36 2023] POST /compute/v2.1/servers/7fabb8d9-4062-418a-b890-48c4b45cf9cf/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:51:47 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:51:47 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:51:47 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-2c8acb29-c6f3-4307-99b9-d495877410d4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:51:47 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-2c8acb29-c6f3-4307-99b9-d495877410d4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:51:48 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2c8acb29-c6f3-4307-99b9-d495877410d4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:48 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2c8acb29-c6f3-4307-99b9-d495877410d4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:48 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2c8acb29-c6f3-4307-99b9-d495877410d4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:48 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2c8acb29-c6f3-4307-99b9-d495877410d4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:48 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2c8acb29-c6f3-4307-99b9-d495877410d4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:48 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2c8acb29-c6f3-4307-99b9-d495877410d4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:48 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-2c8acb29-c6f3-4307-99b9-d495877410d4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df693038f49145b9854ae18d246dde2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455ea6870abe450ba413ffabf4d4097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:51:48 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-2c8acb29-c6f3-4307-99b9-d495877410d4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315" status: 200 len: 1746 microversion: 2.1 time: 0.336954 Apr 17 10:51:48 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 250/726] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:51:47 2023] GET /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315 => generated 1746 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:51:49 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=7 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:51:49 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=9 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:51:49 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-53e49bfa-4046-4b25-971a-0bb7c4a41ddd tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:51:49 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-53e49bfa-4046-4b25-971a-0bb7c4a41ddd tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:51:49 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-53e49bfa-4046-4b25-971a-0bb7c4a41ddd tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:49 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-53e49bfa-4046-4b25-971a-0bb7c4a41ddd tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:49 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-53e49bfa-4046-4b25-971a-0bb7c4a41ddd tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:49 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-53e49bfa-4046-4b25-971a-0bb7c4a41ddd tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:51:49 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-53e49bfa-4046-4b25-971a-0bb7c4a41ddd tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:51:49 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-53e49bfa-4046-4b25-971a-0bb7c4a41ddd tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:51:49 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-53e49bfa-4046-4b25-971a-0bb7c4a41ddd tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:51:49 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-53e49bfa-4046-4b25-971a-0bb7c4a41ddd tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38871910-281e-4aea-9343-79aed3f3b1b9" status: 200 len: 1378 microversion: 2.1 time: 0.297665 Apr 17 10:51:49 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 246/727] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:51:49 2023] GET /compute/v2.1/servers/38871910-281e-4aea-9343-79aed3f3b1b9 => generated 1378 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:52:04 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:52:04 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:52:04 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:52:04 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:52:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:04 user devstack@n-api.service[72744]: DEBUG nova.objects.instance [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lazy-loading 'services' on Instance uuid 7fabb8d9-4062-418a-b890-48c4b45cf9cf {{(pid=72744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 10:52:04 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-bd15995c-757d-4720-8eb4-347c68016e98 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7fabb8d9-4062-418a-b890-48c4b45cf9cf/os-volume_attachments/20b74da5-efb5-4d50-9628-f5170c25ca00" status: 202 len: 0 microversion: 2.1 time: 0.168179 Apr 17 10:52:04 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 232/728] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Apr 17 10:52:04 2023] DELETE /compute/v2.1/servers/7fabb8d9-4062-418a-b890-48c4b45cf9cf/os-volume_attachments/20b74da5-efb5-4d50-9628-f5170c25ca00 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:52:04 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:52:04 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:52:04 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:52:04 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:52:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:04 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Going to try to terminate instance {{(pid=72745) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:52:04 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-cf8301c0-b270-410c-907c-ba78bd865df8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7fabb8d9-4062-418a-b890-48c4b45cf9cf" status: 204 len: 0 microversion: 2.1 time: 0.117883 Apr 17 10:52:04 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 251/729] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:52:04 2023] DELETE /compute/v2.1/servers/7fabb8d9-4062-418a-b890-48c4b45cf9cf => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:52:04 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-fa605207-045e-4b86-8fc8-2442b1ab42b8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:52:04 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-fa605207-045e-4b86-8fc8-2442b1ab42b8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:52:04 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:52:04 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:52:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fa605207-045e-4b86-8fc8-2442b1ab42b8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fa605207-045e-4b86-8fc8-2442b1ab42b8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fa605207-045e-4b86-8fc8-2442b1ab42b8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fa605207-045e-4b86-8fc8-2442b1ab42b8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fa605207-045e-4b86-8fc8-2442b1ab42b8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fa605207-045e-4b86-8fc8-2442b1ab42b8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:04 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-fa605207-045e-4b86-8fc8-2442b1ab42b8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad2b6b478547e78e2cf273ef0390ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652f9a7f20954e23b143e349c538f418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:52:04 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-fa605207-045e-4b86-8fc8-2442b1ab42b8 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7fabb8d9-4062-418a-b890-48c4b45cf9cf" status: 200 len: 1548 microversion: 2.1 time: 0.233207 Apr 17 10:52:04 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 247/730] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:52:04 2023] GET /compute/v2.1/servers/7fabb8d9-4062-418a-b890-48c4b45cf9cf => generated 1548 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:52:06 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-a82f9cad-9776-4421-8cfb-49d11e22daf5 req-dd582b73-4bf8-4068-8523-71ad39fdac92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fabb8d9-4062-418a-b890-48c4b45cf9cf", "name": "network-vif-unplugged", "status": "completed", "tag": "63e11d1a-088d-4c09-b938-48d54ba791fd"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:52:06 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-a82f9cad-9776-4421-8cfb-49d11e22daf5 req-dd582b73-4bf8-4068-8523-71ad39fdac92 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:06 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-a82f9cad-9776-4421-8cfb-49d11e22daf5 req-dd582b73-4bf8-4068-8523-71ad39fdac92 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:06 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-a82f9cad-9776-4421-8cfb-49d11e22daf5 req-dd582b73-4bf8-4068-8523-71ad39fdac92 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:06 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-a82f9cad-9776-4421-8cfb-49d11e22daf5 req-dd582b73-4bf8-4068-8523-71ad39fdac92 service nova] Creating event network-vif-unplugged:63e11d1a-088d-4c09-b938-48d54ba791fd for instance 7fabb8d9-4062-418a-b890-48c4b45cf9cf on user Apr 17 10:52:06 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-a82f9cad-9776-4421-8cfb-49d11e22daf5 req-dd582b73-4bf8-4068-8523-71ad39fdac92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029352 Apr 17 10:52:06 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 233/731] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:52:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:52:07 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-bc0e10c6-0731-4a98-a3d2-0430f8a2009f req-093f99c0-b85b-4d0b-a399-0a72ff1cfdda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fabb8d9-4062-418a-b890-48c4b45cf9cf", "name": "network-vif-deleted", "tag": "63e11d1a-088d-4c09-b938-48d54ba791fd"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:52:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-bc0e10c6-0731-4a98-a3d2-0430f8a2009f req-093f99c0-b85b-4d0b-a399-0a72ff1cfdda service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-bc0e10c6-0731-4a98-a3d2-0430f8a2009f req-093f99c0-b85b-4d0b-a399-0a72ff1cfdda service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-bc0e10c6-0731-4a98-a3d2-0430f8a2009f req-093f99c0-b85b-4d0b-a399-0a72ff1cfdda service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:07 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-bc0e10c6-0731-4a98-a3d2-0430f8a2009f req-093f99c0-b85b-4d0b-a399-0a72ff1cfdda service nova] Creating event network-vif-deleted:63e11d1a-088d-4c09-b938-48d54ba791fd for instance 7fabb8d9-4062-418a-b890-48c4b45cf9cf on user Apr 17 10:52:07 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-bc0e10c6-0731-4a98-a3d2-0430f8a2009f req-093f99c0-b85b-4d0b-a399-0a72ff1cfdda service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031614 Apr 17 10:52:07 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 252/732] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:52:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:52:08 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-5c7b2171-aea3-4c22-bfe4-acb4a537807e req-06807042-0f0b-49d9-a865-ae63e9969ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fabb8d9-4062-418a-b890-48c4b45cf9cf", "name": "network-vif-plugged", "status": "completed", "tag": "63e11d1a-088d-4c09-b938-48d54ba791fd"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:52:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-5c7b2171-aea3-4c22-bfe4-acb4a537807e req-06807042-0f0b-49d9-a865-ae63e9969ff0 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-5c7b2171-aea3-4c22-bfe4-acb4a537807e req-06807042-0f0b-49d9-a865-ae63e9969ff0 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-5c7b2171-aea3-4c22-bfe4-acb4a537807e req-06807042-0f0b-49d9-a865-ae63e9969ff0 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:08 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-5c7b2171-aea3-4c22-bfe4-acb4a537807e req-06807042-0f0b-49d9-a865-ae63e9969ff0 service nova] Creating event network-vif-plugged:63e11d1a-088d-4c09-b938-48d54ba791fd for instance 7fabb8d9-4062-418a-b890-48c4b45cf9cf on user Apr 17 10:52:08 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-5c7b2171-aea3-4c22-bfe4-acb4a537807e req-06807042-0f0b-49d9-a865-ae63e9969ff0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037845 Apr 17 10:52:08 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 248/733] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:52:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:52:13 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:52:13 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:52:13 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:13 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:13 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:13 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:13 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:13 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:13 user devstack@n-api.service[72744]: DEBUG nova.objects.instance [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lazy-loading 'services' on Instance uuid 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 {{(pid=72744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 10:52:14 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-e7f80ea4-0162-4987-98f7-13aaf55b4bd3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/os-volume_attachments/ed14165c-7141-4cb0-816c-aa875719d300" status: 202 len: 0 microversion: 2.1 time: 0.176692 Apr 17 10:52:14 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 234/734] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Apr 17 10:52:13 2023] DELETE /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/os-volume_attachments/ed14165c-7141-4cb0-816c-aa875719d300 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:52:14 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-9b03ed89-6957-4e43-984b-641b687fe4b0 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:52:14 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-9b03ed89-6957-4e43-984b-641b687fe4b0 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:52:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9b03ed89-6957-4e43-984b-641b687fe4b0 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9b03ed89-6957-4e43-984b-641b687fe4b0 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9b03ed89-6957-4e43-984b-641b687fe4b0 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9b03ed89-6957-4e43-984b-641b687fe4b0 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9b03ed89-6957-4e43-984b-641b687fe4b0 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9b03ed89-6957-4e43-984b-641b687fe4b0 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:14 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-9b03ed89-6957-4e43-984b-641b687fe4b0 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047246 Apr 17 10:52:14 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 253/735] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:52:14 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:52:17 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-c44aef55-a474-44d3-a808-412a044cf260 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:52:17 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-c44aef55-a474-44d3-a808-412a044cf260 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] [instance: d61e9333-fe01-4a9e-abab-ef31ba6d4173] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:52:17 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c44aef55-a474-44d3-a808-412a044cf260 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:17 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c44aef55-a474-44d3-a808-412a044cf260 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:17 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c44aef55-a474-44d3-a808-412a044cf260 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:17 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c44aef55-a474-44d3-a808-412a044cf260 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:17 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c44aef55-a474-44d3-a808-412a044cf260 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:17 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c44aef55-a474-44d3-a808-412a044cf260 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:17 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-c44aef55-a474-44d3-a808-412a044cf260 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] HTTP exception thrown: Instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 could not be found. Apr 17 10:52:17 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-c44aef55-a474-44d3-a808-412a044cf260 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Request method failure captured: Apr 17 10:52:17 user devstack@n-api.service[72743]: request: GET /compute/v2.1/servers/d61e9333-fe01-4a9e-abab-ef31ba6d4173 HTTP/1.1 Apr 17 10:52:17 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:52:17 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:52:17 user devstack@n-api.service[72743]: Connection: close Apr 17 10:52:17 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:52:17 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:52:17 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:52:17 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:52:17 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:52:17 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSMAQ6pXdTDNWnNt-XWgQj7MYkWlDd-UyN_F40GWGPmxdEcy4U1rIyN_vggYNXfAYIr7lqck09FHQbeJTqAvadkEFBmqkneKZKB11tC3Y9RkWp7uooEvuYyOfWAO237XmEqRuF1lmmUsjmXaokl5CVtD2qkjP1B_jo3Sd47i1feJnzA Apr 17 10:52:17 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:52:17 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:52:17 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:52:17 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:52:17 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:52:17 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:52:17 user devstack@n-api.service[72743]: X-Project-Id: 84cd384dfcbb4739b9694704c1fad001 Apr 17 10:52:17 user devstack@n-api.service[72743]: X-Project-Name: tempest-TestStampPattern-2056640667 Apr 17 10:52:17 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:52:17 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:52:17 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/84cd384dfcbb4739b9694704c1fad001"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/84cd384dfcbb4739b9694704c1fad001"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/84cd384dfcbb4739b9694704c1fad001"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:52:17 user devstack@n-api.service[72743]: X-Tenant: tempest-TestStampPattern-2056640667 Apr 17 10:52:17 user devstack@n-api.service[72743]: X-Tenant-Id: 84cd384dfcbb4739b9694704c1fad001 Apr 17 10:52:17 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-TestStampPattern-2056640667 Apr 17 10:52:17 user devstack@n-api.service[72743]: X-User: tempest-TestStampPattern-2056640667-project-member Apr 17 10:52:17 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:52:17 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:52:17 user devstack@n-api.service[72743]: X-User-Id: 708740584a3d488da0ee13e5f8299b7f Apr 17 10:52:17 user devstack@n-api.service[72743]: X-User-Name: tempest-TestStampPattern-2056640667-project-member Apr 17 10:52:17 user devstack@n-api.service[72743]: method: > Apr 17 10:52:17 user devstack@n-api.service[72743]: exception: Instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 could not be found. Apr 17 10:52:17 user devstack@n-api.service[72743]: action_args: {'id': 'd61e9333-fe01-4a9e-abab-ef31ba6d4173'} Apr 17 10:52:17 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 could not be found. Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 could not be found. Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 could not be found. Apr 17 10:52:17 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:52:17 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-c44aef55-a474-44d3-a808-412a044cf260 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Returning 404 to user: Instance d61e9333-fe01-4a9e-abab-ef31ba6d4173 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:52:17 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-c44aef55-a474-44d3-a808-412a044cf260 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d61e9333-fe01-4a9e-abab-ef31ba6d4173" status: 404 len: 111 microversion: 2.1 time: 0.034767 Apr 17 10:52:17 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 249/736] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:52:17 2023] GET /compute/v2.1/servers/d61e9333-fe01-4a9e-abab-ef31ba6d4173 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:52:20 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-fec9d06a-bb31-4366-b23e-850ea991a8b4 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] Calling method '.version_select at 0x7fc55a74dc60>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:52:20 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-fec9d06a-bb31-4366-b23e-850ea991a8b4 tempest-TestStampPattern-2056640667 tempest-TestStampPattern-2056640667-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-12722321" status: 202 len: 0 microversion: 2.1 time: 0.022856 Apr 17 10:52:20 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 235/737] 10.0.0.210 () {62 vars in 1319 bytes} [Mon Apr 17 10:52:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-12722321 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:52:23 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:52:23 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:52:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:23 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Going to try to terminate instance {{(pid=72745) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:52:23 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-6ab88863-5d60-473f-8995-d790b9f9ddde tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e198ad00-927f-45e1-9f14-828d56ce3393" status: 204 len: 0 microversion: 2.87 time: 0.127314 Apr 17 10:52:23 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 254/738] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 17 10:52:23 2023] DELETE /compute/v2.1/servers/e198ad00-927f-45e1-9f14-828d56ce3393 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 17 10:52:23 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-ae2c79e1-c171-4701-9b8d-f64447cb54b4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:52:23 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-ae2c79e1-c171-4701-9b8d-f64447cb54b4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:52:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ae2c79e1-c171-4701-9b8d-f64447cb54b4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ae2c79e1-c171-4701-9b8d-f64447cb54b4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ae2c79e1-c171-4701-9b8d-f64447cb54b4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ae2c79e1-c171-4701-9b8d-f64447cb54b4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ae2c79e1-c171-4701-9b8d-f64447cb54b4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ae2c79e1-c171-4701-9b8d-f64447cb54b4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:23 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-d67e429c-68a6-48fb-b10d-6f4e5f8a7cba req-891a0b07-b3c6-41ee-8e0f-5f44896beaba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e198ad00-927f-45e1-9f14-828d56ce3393", "name": "network-vif-unplugged", "status": "completed", "tag": "8b03fa35-eaab-40ea-a06b-afa4bd410981"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:52:23 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-d67e429c-68a6-48fb-b10d-6f4e5f8a7cba req-891a0b07-b3c6-41ee-8e0f-5f44896beaba service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:23 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-d67e429c-68a6-48fb-b10d-6f4e5f8a7cba req-891a0b07-b3c6-41ee-8e0f-5f44896beaba service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:23 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-d67e429c-68a6-48fb-b10d-6f4e5f8a7cba req-891a0b07-b3c6-41ee-8e0f-5f44896beaba service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:23 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-d67e429c-68a6-48fb-b10d-6f4e5f8a7cba req-891a0b07-b3c6-41ee-8e0f-5f44896beaba service nova] Creating event network-vif-unplugged:8b03fa35-eaab-40ea-a06b-afa4bd410981 for instance e198ad00-927f-45e1-9f14-828d56ce3393 on user Apr 17 10:52:23 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-d67e429c-68a6-48fb-b10d-6f4e5f8a7cba req-891a0b07-b3c6-41ee-8e0f-5f44896beaba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030508 Apr 17 10:52:23 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 236/739] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:52:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:52:23 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-ae2c79e1-c171-4701-9b8d-f64447cb54b4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:52:23 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-ae2c79e1-c171-4701-9b8d-f64447cb54b4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:52:23 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-ae2c79e1-c171-4701-9b8d-f64447cb54b4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:52:23 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-ae2c79e1-c171-4701-9b8d-f64447cb54b4 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e198ad00-927f-45e1-9f14-828d56ce3393" status: 200 len: 1775 microversion: 2.87 time: 0.393573 Apr 17 10:52:23 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 250/740] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:52:23 2023] GET /compute/v2.1/servers/e198ad00-927f-45e1-9f14-828d56ce3393 => generated 1775 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:52:25 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-9fcdc563-8c0e-4cf4-92d1-7ca2e56a5dc3 req-7db3601a-225f-45be-84b5-d9b2cd29a635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e198ad00-927f-45e1-9f14-828d56ce3393", "name": "network-vif-deleted", "tag": "8b03fa35-eaab-40ea-a06b-afa4bd410981"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:52:25 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-9fcdc563-8c0e-4cf4-92d1-7ca2e56a5dc3 req-7db3601a-225f-45be-84b5-d9b2cd29a635 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:25 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-9fcdc563-8c0e-4cf4-92d1-7ca2e56a5dc3 req-7db3601a-225f-45be-84b5-d9b2cd29a635 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:25 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-9fcdc563-8c0e-4cf4-92d1-7ca2e56a5dc3 req-7db3601a-225f-45be-84b5-d9b2cd29a635 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:25 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-9fcdc563-8c0e-4cf4-92d1-7ca2e56a5dc3 req-7db3601a-225f-45be-84b5-d9b2cd29a635 service nova] Creating event network-vif-deleted:8b03fa35-eaab-40ea-a06b-afa4bd410981 for instance e198ad00-927f-45e1-9f14-828d56ce3393 on user Apr 17 10:52:25 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-9fcdc563-8c0e-4cf4-92d1-7ca2e56a5dc3 req-7db3601a-225f-45be-84b5-d9b2cd29a635 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033903 Apr 17 10:52:25 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 255/741] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:52:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:52:26 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-4a399ae1-a39e-41ef-a3a1-e27db18ae123 req-5b04f09a-5740-47e2-ad25-f7e65c415731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e198ad00-927f-45e1-9f14-828d56ce3393", "name": "network-vif-plugged", "status": "completed", "tag": "8b03fa35-eaab-40ea-a06b-afa4bd410981"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:52:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-4a399ae1-a39e-41ef-a3a1-e27db18ae123 req-5b04f09a-5740-47e2-ad25-f7e65c415731 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-4a399ae1-a39e-41ef-a3a1-e27db18ae123 req-5b04f09a-5740-47e2-ad25-f7e65c415731 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-4a399ae1-a39e-41ef-a3a1-e27db18ae123 req-5b04f09a-5740-47e2-ad25-f7e65c415731 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:26 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-4a399ae1-a39e-41ef-a3a1-e27db18ae123 req-5b04f09a-5740-47e2-ad25-f7e65c415731 service nova] Creating event network-vif-plugged:8b03fa35-eaab-40ea-a06b-afa4bd410981 for instance e198ad00-927f-45e1-9f14-828d56ce3393 on user Apr 17 10:52:26 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-4a399ae1-a39e-41ef-a3a1-e27db18ae123 req-5b04f09a-5740-47e2-ad25-f7e65c415731 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029445 Apr 17 10:52:26 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 237/742] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:52:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:52:48 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-7c3e9277-4829-4df7-af68-c50318f842e7 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-182384916"}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:52:48 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-7c3e9277-4829-4df7-af68-c50318f842e7 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:52:48 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=16 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:52:48 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=10 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:52:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7c3e9277-4829-4df7-af68-c50318f842e7 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7c3e9277-4829-4df7-af68-c50318f842e7 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7c3e9277-4829-4df7-af68-c50318f842e7 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7c3e9277-4829-4df7-af68-c50318f842e7 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7c3e9277-4829-4df7-af68-c50318f842e7 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7c3e9277-4829-4df7-af68-c50318f842e7 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:48 user devstack@n-api.service[72743]: INFO nova.network.security_group_api [None req-7c3e9277-4829-4df7-af68-c50318f842e7 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Removing security group c07f8d40-7da6-49a4-af77-6bbda9efa653 from port 65f23819-ccfb-4eb0-adc1-3f9895ed9c39 Apr 17 10:52:49 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-7c3e9277-4829-4df7-af68-c50318f842e7 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315/action" status: 202 len: 0 microversion: 2.1 time: 0.791452 Apr 17 10:52:49 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 251/743] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 10:52:48 2023] POST /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315/action => generated 0 bytes in 793 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:52:49 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:52:49 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:52:49 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-a8360552-2107-4920-93d0-1d6eb4e47fdb req-34e96627-3b21-4a80-ba9a-69a2e189b1b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fd89020-5492-4e40-a911-63f9b1b43315", "tag": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:52:49 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-a8360552-2107-4920-93d0-1d6eb4e47fdb req-34e96627-3b21-4a80-ba9a-69a2e189b1b3 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:49 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-a8360552-2107-4920-93d0-1d6eb4e47fdb req-34e96627-3b21-4a80-ba9a-69a2e189b1b3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:49 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-a8360552-2107-4920-93d0-1d6eb4e47fdb req-34e96627-3b21-4a80-ba9a-69a2e189b1b3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:49 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-a8360552-2107-4920-93d0-1d6eb4e47fdb req-34e96627-3b21-4a80-ba9a-69a2e189b1b3 service nova] Creating event network-changed:65f23819-ccfb-4eb0-adc1-3f9895ed9c39 for instance 3fd89020-5492-4e40-a911-63f9b1b43315 on user Apr 17 10:52:49 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-a8360552-2107-4920-93d0-1d6eb4e47fdb req-34e96627-3b21-4a80-ba9a-69a2e189b1b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042050 Apr 17 10:52:49 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 256/744] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:52:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:52:49 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:52:49 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=24,nova_cell1:INSERT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:52:49 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-ad750a91-b1c4-4677-b1d9-4f09d92a71eb tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:52:49 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-ad750a91-b1c4-4677-b1d9-4f09d92a71eb tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:52:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ad750a91-b1c4-4677-b1d9-4f09d92a71eb tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ad750a91-b1c4-4677-b1d9-4f09d92a71eb tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ad750a91-b1c4-4677-b1d9-4f09d92a71eb tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ad750a91-b1c4-4677-b1d9-4f09d92a71eb tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ad750a91-b1c4-4677-b1d9-4f09d92a71eb tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ad750a91-b1c4-4677-b1d9-4f09d92a71eb tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:50 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-ad750a91-b1c4-4677-b1d9-4f09d92a71eb tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:52:50 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-ad750a91-b1c4-4677-b1d9-4f09d92a71eb tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38871910-281e-4aea-9343-79aed3f3b1b9" status: 200 len: 1378 microversion: 2.1 time: 0.372196 Apr 17 10:52:50 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 238/745] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:52:49 2023] GET /compute/v2.1/servers/38871910-281e-4aea-9343-79aed3f3b1b9 => generated 1378 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:52:50 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-2ea45d3b-a54d-4de3-a2cd-ff677426d25c tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:52:50 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-2ea45d3b-a54d-4de3-a2cd-ff677426d25c tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:52:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2ea45d3b-a54d-4de3-a2cd-ff677426d25c tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2ea45d3b-a54d-4de3-a2cd-ff677426d25c tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2ea45d3b-a54d-4de3-a2cd-ff677426d25c tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2ea45d3b-a54d-4de3-a2cd-ff677426d25c tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2ea45d3b-a54d-4de3-a2cd-ff677426d25c tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2ea45d3b-a54d-4de3-a2cd-ff677426d25c tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:50 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-2ea45d3b-a54d-4de3-a2cd-ff677426d25c tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:52:50 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-2ea45d3b-a54d-4de3-a2cd-ff677426d25c tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38871910-281e-4aea-9343-79aed3f3b1b9" status: 200 len: 1378 microversion: 2.1 time: 0.158246 Apr 17 10:52:50 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 252/746] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:52:50 2023] GET /compute/v2.1/servers/38871910-281e-4aea-9343-79aed3f3b1b9 => generated 1378 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:52:50 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-790897cf-998c-47aa-b40b-d785b2efa439 req-c4f0e251-081e-474d-a5ec-619386926672 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fd89020-5492-4e40-a911-63f9b1b43315", "tag": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:52:50 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:52:50 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:52:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-790897cf-998c-47aa-b40b-d785b2efa439 req-c4f0e251-081e-474d-a5ec-619386926672 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-790897cf-998c-47aa-b40b-d785b2efa439 req-c4f0e251-081e-474d-a5ec-619386926672 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-790897cf-998c-47aa-b40b-d785b2efa439 req-c4f0e251-081e-474d-a5ec-619386926672 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:50 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-790897cf-998c-47aa-b40b-d785b2efa439 req-c4f0e251-081e-474d-a5ec-619386926672 service nova] Creating event network-changed:65f23819-ccfb-4eb0-adc1-3f9895ed9c39 for instance 3fd89020-5492-4e40-a911-63f9b1b43315 on user Apr 17 10:52:50 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-790897cf-998c-47aa-b40b-d785b2efa439 req-c4f0e251-081e-474d-a5ec-619386926672 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027713 Apr 17 10:52:50 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 239/747] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:52:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:52:50 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Going to try to terminate instance {{(pid=72745) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:52:50 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:52:50 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:52:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:50 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-6a0610a6-c058-4f3f-91c9-5d9949b32252 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/38871910-281e-4aea-9343-79aed3f3b1b9" status: 204 len: 0 microversion: 2.1 time: 0.115333 Apr 17 10:52:50 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 257/748] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:52:50 2023] DELETE /compute/v2.1/servers/38871910-281e-4aea-9343-79aed3f3b1b9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:52:50 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-e1897432-8628-4ea2-8f8a-0f4a14026c0f tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:52:50 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-e1897432-8628-4ea2-8f8a-0f4a14026c0f tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:52:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e1897432-8628-4ea2-8f8a-0f4a14026c0f tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e1897432-8628-4ea2-8f8a-0f4a14026c0f tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e1897432-8628-4ea2-8f8a-0f4a14026c0f tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e1897432-8628-4ea2-8f8a-0f4a14026c0f tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e1897432-8628-4ea2-8f8a-0f4a14026c0f tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e1897432-8628-4ea2-8f8a-0f4a14026c0f tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:50 user devstack@n-api.service[72743]: DEBUG nova.objects.instance [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lazy-loading 'services' on Instance uuid 3fd89020-5492-4e40-a911-63f9b1b43315 {{(pid=72743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 10:52:50 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-8ea0e251-3eaa-49b5-accb-a7c26f8e9cdd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315/os-volume_attachments/0f4bbb72-51fe-46f3-a970-cb6f934f63f3" status: 202 len: 0 microversion: 2.1 time: 0.185268 Apr 17 10:52:50 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 253/749] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Apr 17 10:52:50 2023] DELETE /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315/os-volume_attachments/0f4bbb72-51fe-46f3-a970-cb6f934f63f3 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:52:50 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-982497bb-54ff-42f5-8053-67e7d531196f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:52:50 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-982497bb-54ff-42f5-8053-67e7d531196f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:52:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-982497bb-54ff-42f5-8053-67e7d531196f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-982497bb-54ff-42f5-8053-67e7d531196f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-982497bb-54ff-42f5-8053-67e7d531196f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-982497bb-54ff-42f5-8053-67e7d531196f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-982497bb-54ff-42f5-8053-67e7d531196f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-982497bb-54ff-42f5-8053-67e7d531196f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:50 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-982497bb-54ff-42f5-8053-67e7d531196f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057789 Apr 17 10:52:50 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 258/750] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:52:50 2023] GET /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:52:50 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-8c7d38bb-df79-46e7-ad49-d5a085b2e690 req-4c4e79d5-78a4-4a84-a69c-4d25313c7c6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38871910-281e-4aea-9343-79aed3f3b1b9", "name": "network-vif-unplugged", "status": "completed", "tag": "477fa3ea-f59d-4fc6-8eb8-4cf064201e14"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:52:50 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-e1897432-8628-4ea2-8f8a-0f4a14026c0f tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:52:50 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-e1897432-8628-4ea2-8f8a-0f4a14026c0f tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38871910-281e-4aea-9343-79aed3f3b1b9" status: 200 len: 1384 microversion: 2.1 time: 0.250224 Apr 17 10:52:50 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 240/751] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:52:50 2023] GET /compute/v2.1/servers/38871910-281e-4aea-9343-79aed3f3b1b9 => generated 1384 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:52:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-8c7d38bb-df79-46e7-ad49-d5a085b2e690 req-4c4e79d5-78a4-4a84-a69c-4d25313c7c6c service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-8c7d38bb-df79-46e7-ad49-d5a085b2e690 req-4c4e79d5-78a4-4a84-a69c-4d25313c7c6c service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-8c7d38bb-df79-46e7-ad49-d5a085b2e690 req-4c4e79d5-78a4-4a84-a69c-4d25313c7c6c service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:50 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-8c7d38bb-df79-46e7-ad49-d5a085b2e690 req-4c4e79d5-78a4-4a84-a69c-4d25313c7c6c service nova] Creating event network-vif-unplugged:477fa3ea-f59d-4fc6-8eb8-4cf064201e14 for instance 38871910-281e-4aea-9343-79aed3f3b1b9 on user Apr 17 10:52:50 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-8c7d38bb-df79-46e7-ad49-d5a085b2e690 req-4c4e79d5-78a4-4a84-a69c-4d25313c7c6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030704 Apr 17 10:52:50 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 254/752] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:52:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:52:52 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-3c847763-a391-4979-b1eb-c548af4ed5af req-776847cd-2635-499f-a94f-58192236322a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38871910-281e-4aea-9343-79aed3f3b1b9", "name": "network-vif-plugged", "status": "completed", "tag": "477fa3ea-f59d-4fc6-8eb8-4cf064201e14"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:52:52 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-f94749fa-04f1-4f33-b5f7-886340f9737c req-9abd5533-21a2-4acb-a277-7e6021f836f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38871910-281e-4aea-9343-79aed3f3b1b9", "name": "network-vif-deleted", "tag": "477fa3ea-f59d-4fc6-8eb8-4cf064201e14"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:52:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-3c847763-a391-4979-b1eb-c548af4ed5af req-776847cd-2635-499f-a94f-58192236322a service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-3c847763-a391-4979-b1eb-c548af4ed5af req-776847cd-2635-499f-a94f-58192236322a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-3c847763-a391-4979-b1eb-c548af4ed5af req-776847cd-2635-499f-a94f-58192236322a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:52 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-f94749fa-04f1-4f33-b5f7-886340f9737c req-9abd5533-21a2-4acb-a277-7e6021f836f3 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:52 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-f94749fa-04f1-4f33-b5f7-886340f9737c req-9abd5533-21a2-4acb-a277-7e6021f836f3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:52 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-f94749fa-04f1-4f33-b5f7-886340f9737c req-9abd5533-21a2-4acb-a277-7e6021f836f3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:52 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-f94749fa-04f1-4f33-b5f7-886340f9737c req-9abd5533-21a2-4acb-a277-7e6021f836f3 service nova] Creating event network-vif-deleted:477fa3ea-f59d-4fc6-8eb8-4cf064201e14 for instance 38871910-281e-4aea-9343-79aed3f3b1b9 on user Apr 17 10:52:52 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-3c847763-a391-4979-b1eb-c548af4ed5af req-776847cd-2635-499f-a94f-58192236322a service nova] Creating event network-vif-plugged:477fa3ea-f59d-4fc6-8eb8-4cf064201e14 for instance 38871910-281e-4aea-9343-79aed3f3b1b9 on user Apr 17 10:52:52 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-f94749fa-04f1-4f33-b5f7-886340f9737c req-9abd5533-21a2-4acb-a277-7e6021f836f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030575 Apr 17 10:52:52 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 241/753] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:52:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:52:52 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-3c847763-a391-4979-b1eb-c548af4ed5af req-776847cd-2635-499f-a94f-58192236322a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038255 Apr 17 10:52:52 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 259/754] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:52:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:52:54 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-3e6ce114-980a-46a3-b080-ef031cfc2627 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:52:54 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-3e6ce114-980a-46a3-b080-ef031cfc2627 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 7fabb8d9-4062-418a-b890-48c4b45cf9cf] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:52:54 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3e6ce114-980a-46a3-b080-ef031cfc2627 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:54 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3e6ce114-980a-46a3-b080-ef031cfc2627 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:54 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3e6ce114-980a-46a3-b080-ef031cfc2627 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:54 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3e6ce114-980a-46a3-b080-ef031cfc2627 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:52:54 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3e6ce114-980a-46a3-b080-ef031cfc2627 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:52:54 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3e6ce114-980a-46a3-b080-ef031cfc2627 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:52:54 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-3e6ce114-980a-46a3-b080-ef031cfc2627 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] HTTP exception thrown: Instance 7fabb8d9-4062-418a-b890-48c4b45cf9cf could not be found. Apr 17 10:52:54 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-3e6ce114-980a-46a3-b080-ef031cfc2627 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Request method failure captured: Apr 17 10:52:54 user devstack@n-api.service[72743]: request: GET /compute/v2.1/servers/7fabb8d9-4062-418a-b890-48c4b45cf9cf HTTP/1.1 Apr 17 10:52:54 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:52:54 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:52:54 user devstack@n-api.service[72743]: Connection: close Apr 17 10:52:54 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:52:54 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:52:54 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:52:54 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:52:54 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:52:54 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSRCGBQUFOVVFYw4pUl-LTu4JKqlZev9Hwk5z4msYCeDd-DjSTg-Z4DCitN8-Dpu0aR2_Ygh5WrzP9jHkIUVgzAC7dUFP4q4uWs-B13qsNHLt5WEHdjCikGSvaR7joLGWoUVR6ebkj_V5iSOe6yPeL2RB84eXzxQBcPWbXTZQY3B4X8 Apr 17 10:52:54 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:52:54 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:52:54 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:52:54 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:52:54 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:52:54 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:52:54 user devstack@n-api.service[72743]: X-Project-Id: 652f9a7f20954e23b143e349c538f418 Apr 17 10:52:54 user devstack@n-api.service[72743]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1076174579 Apr 17 10:52:54 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:52:54 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:52:54 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/652f9a7f20954e23b143e349c538f418"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/652f9a7f20954e23b143e349c538f418"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/652f9a7f20954e23b143e349c538f418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:52:54 user devstack@n-api.service[72743]: X-Tenant: tempest-VolumesSnapshotTestJSON-1076174579 Apr 17 10:52:54 user devstack@n-api.service[72743]: X-Tenant-Id: 652f9a7f20954e23b143e349c538f418 Apr 17 10:52:54 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1076174579 Apr 17 10:52:54 user devstack@n-api.service[72743]: X-User: tempest-VolumesSnapshotTestJSON-1076174579-project-member Apr 17 10:52:54 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:52:54 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:52:54 user devstack@n-api.service[72743]: X-User-Id: 30ad2b6b478547e78e2cf273ef0390ed Apr 17 10:52:54 user devstack@n-api.service[72743]: X-User-Name: tempest-VolumesSnapshotTestJSON-1076174579-project-member Apr 17 10:52:54 user devstack@n-api.service[72743]: method: > Apr 17 10:52:54 user devstack@n-api.service[72743]: exception: Instance 7fabb8d9-4062-418a-b890-48c4b45cf9cf could not be found. Apr 17 10:52:54 user devstack@n-api.service[72743]: action_args: {'id': '7fabb8d9-4062-418a-b890-48c4b45cf9cf'} Apr 17 10:52:54 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fabb8d9-4062-418a-b890-48c4b45cf9cf could not be found. Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fabb8d9-4062-418a-b890-48c4b45cf9cf could not be found. Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fabb8d9-4062-418a-b890-48c4b45cf9cf could not be found. Apr 17 10:52:54 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:52:54 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-3e6ce114-980a-46a3-b080-ef031cfc2627 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Returning 404 to user: Instance 7fabb8d9-4062-418a-b890-48c4b45cf9cf could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:52:54 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-3e6ce114-980a-46a3-b080-ef031cfc2627 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7fabb8d9-4062-418a-b890-48c4b45cf9cf" status: 404 len: 111 microversion: 2.1 time: 0.046842 Apr 17 10:52:54 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 255/755] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:52:54 2023] GET /compute/v2.1/servers/7fabb8d9-4062-418a-b890-48c4b45cf9cf => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:53:04 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=8 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:53:04 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=16 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:53:04 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-00fdbd73-76be-4b7a-b6a2-c5fc1804c919 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:53:04 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-00fdbd73-76be-4b7a-b6a2-c5fc1804c919 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:53:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-00fdbd73-76be-4b7a-b6a2-c5fc1804c919 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-00fdbd73-76be-4b7a-b6a2-c5fc1804c919 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-00fdbd73-76be-4b7a-b6a2-c5fc1804c919 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-00fdbd73-76be-4b7a-b6a2-c5fc1804c919 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-00fdbd73-76be-4b7a-b6a2-c5fc1804c919 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-00fdbd73-76be-4b7a-b6a2-c5fc1804c919 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:04 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-00fdbd73-76be-4b7a-b6a2-c5fc1804c919 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052706 Apr 17 10:53:04 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 242/756] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:53:04 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 17 10:53:04 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:53:04 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:53:04 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-6f816c66-5589-4792-aa65-a3b04751a0b5 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:53:04 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-6f816c66-5589-4792-aa65-a3b04751a0b5 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:53:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6f816c66-5589-4792-aa65-a3b04751a0b5 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6f816c66-5589-4792-aa65-a3b04751a0b5 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6f816c66-5589-4792-aa65-a3b04751a0b5 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6f816c66-5589-4792-aa65-a3b04751a0b5 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6f816c66-5589-4792-aa65-a3b04751a0b5 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-6f816c66-5589-4792-aa65-a3b04751a0b5 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:04 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-6f816c66-5589-4792-aa65-a3b04751a0b5 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:53:04 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-6f816c66-5589-4792-aa65-a3b04751a0b5 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 200 len: 1675 microversion: 2.1 time: 0.277318 Apr 17 10:53:04 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 260/757] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:53:04 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 1675 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:53:04 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b6acdc19-75dc-46c2-947c-023f39257c77 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:53:04 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-b6acdc19-75dc-46c2-947c-023f39257c77 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:53:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b6acdc19-75dc-46c2-947c-023f39257c77 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b6acdc19-75dc-46c2-947c-023f39257c77 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b6acdc19-75dc-46c2-947c-023f39257c77 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b6acdc19-75dc-46c2-947c-023f39257c77 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b6acdc19-75dc-46c2-947c-023f39257c77 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b6acdc19-75dc-46c2-947c-023f39257c77 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:04 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-b6acdc19-75dc-46c2-947c-023f39257c77 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:53:04 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-b6acdc19-75dc-46c2-947c-023f39257c77 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 200 len: 1675 microversion: 2.1 time: 0.246082 Apr 17 10:53:04 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 256/758] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:53:04 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 1675 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:53:04 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-7edb45a3-0054-43bc-a184-635f5ac25daf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:53:04 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-7edb45a3-0054-43bc-a184-635f5ac25daf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:53:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7edb45a3-0054-43bc-a184-635f5ac25daf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7edb45a3-0054-43bc-a184-635f5ac25daf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7edb45a3-0054-43bc-a184-635f5ac25daf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7edb45a3-0054-43bc-a184-635f5ac25daf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7edb45a3-0054-43bc-a184-635f5ac25daf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7edb45a3-0054-43bc-a184-635f5ac25daf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:05 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-7edb45a3-0054-43bc-a184-635f5ac25daf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:53:05 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-7edb45a3-0054-43bc-a184-635f5ac25daf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 200 len: 1675 microversion: 2.1 time: 0.154032 Apr 17 10:53:05 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 243/759] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:53:04 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:53:08 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1125305067", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "networks": [{"uuid": "5b563383-5272-4d22-a617-c3a91d7b84c9"}]}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:53:08 user devstack@n-api.service[72745]: DEBUG nova.network.neutron [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] validate_networks() for [('5b563383-5272-4d22-a617-c3a91d7b84c9', None, None, None, None, None)] {{(pid=72745) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:53:08 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Flavor limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:53:08 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Image limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:53:08 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Flavor pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:53:08 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Image pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:53:08 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:53:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:08 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Getting quotas for project 652f9a7f20954e23b143e349c538f418. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:53:08 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Getting quotas for user 30ad2b6b478547e78e2cf273ef0390ed and project 652f9a7f20954e23b143e349c538f418. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:53:08 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Going to run 1 instances... {{(pid=72745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:53:08 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:53:08 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-d95d1958-b409-42bb-8a69-d7eff8c15931 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.732643 Apr 17 10:53:08 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 261/760] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:53:08 2023] POST /compute/v2.1/servers => generated 378 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 10:53:08 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-9a376507-40b7-4cc9-a3a6-56aef875c6d0 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:53:08 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-9a376507-40b7-4cc9-a3a6-56aef875c6d0 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:53:08 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-9a376507-40b7-4cc9-a3a6-56aef875c6d0 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad2b6b478547e78e2cf273ef0390ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652f9a7f20954e23b143e349c538f418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:53:08 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-9a376507-40b7-4cc9-a3a6-56aef875c6d0 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0deb56c2-1224-488f-9d30-4082ec677dc7" status: 200 len: 1213 microversion: 2.1 time: 0.065910 Apr 17 10:53:08 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 257/761] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:53:08 2023] GET /compute/v2.1/servers/0deb56c2-1224-488f-9d30-4082ec677dc7 => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:53:11 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-5c7bf09a-a265-4e63-b01e-dca7445bb669 req-8af52650-45d6-439e-bfa6-26dfcc7117a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0deb56c2-1224-488f-9d30-4082ec677dc7", "tag": "0464e1cc-c5eb-4e76-be88-393898a80f3b"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:53:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-5c7bf09a-a265-4e63-b01e-dca7445bb669 req-8af52650-45d6-439e-bfa6-26dfcc7117a4 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-5c7bf09a-a265-4e63-b01e-dca7445bb669 req-8af52650-45d6-439e-bfa6-26dfcc7117a4 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-5c7bf09a-a265-4e63-b01e-dca7445bb669 req-8af52650-45d6-439e-bfa6-26dfcc7117a4 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-5c7bf09a-a265-4e63-b01e-dca7445bb669 req-8af52650-45d6-439e-bfa6-26dfcc7117a4 service nova] Creating event network-changed:0464e1cc-c5eb-4e76-be88-393898a80f3b for instance 0deb56c2-1224-488f-9d30-4082ec677dc7 on user Apr 17 10:53:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-5c7bf09a-a265-4e63-b01e-dca7445bb669 req-8af52650-45d6-439e-bfa6-26dfcc7117a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029462 Apr 17 10:53:11 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 244/762] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:53:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:53:13 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-52bc4fc5-29d6-4365-ae18-a331e2b535dc req-6cc3854a-6e8b-459e-9529-187629902eea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0deb56c2-1224-488f-9d30-4082ec677dc7", "name": "network-vif-plugged", "status": "completed", "tag": "0464e1cc-c5eb-4e76-be88-393898a80f3b"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:53:13 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-52bc4fc5-29d6-4365-ae18-a331e2b535dc req-6cc3854a-6e8b-459e-9529-187629902eea service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:13 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-52bc4fc5-29d6-4365-ae18-a331e2b535dc req-6cc3854a-6e8b-459e-9529-187629902eea service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:13 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-52bc4fc5-29d6-4365-ae18-a331e2b535dc req-6cc3854a-6e8b-459e-9529-187629902eea service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:13 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-52bc4fc5-29d6-4365-ae18-a331e2b535dc req-6cc3854a-6e8b-459e-9529-187629902eea service nova] Creating event network-vif-plugged:0464e1cc-c5eb-4e76-be88-393898a80f3b for instance 0deb56c2-1224-488f-9d30-4082ec677dc7 on user Apr 17 10:53:13 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-52bc4fc5-29d6-4365-ae18-a331e2b535dc req-6cc3854a-6e8b-459e-9529-187629902eea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027662 Apr 17 10:53:13 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 262/763] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:53:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:53:14 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b2b7e259-c0a7-4bc2-81d3-f67ccef51ca1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:53:14 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-b2b7e259-c0a7-4bc2-81d3-f67ccef51ca1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: e198ad00-927f-45e1-9f14-828d56ce3393] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:53:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b2b7e259-c0a7-4bc2-81d3-f67ccef51ca1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b2b7e259-c0a7-4bc2-81d3-f67ccef51ca1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b2b7e259-c0a7-4bc2-81d3-f67ccef51ca1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b2b7e259-c0a7-4bc2-81d3-f67ccef51ca1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b2b7e259-c0a7-4bc2-81d3-f67ccef51ca1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b2b7e259-c0a7-4bc2-81d3-f67ccef51ca1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:14 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-b2b7e259-c0a7-4bc2-81d3-f67ccef51ca1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] HTTP exception thrown: Instance e198ad00-927f-45e1-9f14-828d56ce3393 could not be found. Apr 17 10:53:14 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b2b7e259-c0a7-4bc2-81d3-f67ccef51ca1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Request method failure captured: Apr 17 10:53:14 user devstack@n-api.service[72743]: request: GET /compute/v2.1/servers/e198ad00-927f-45e1-9f14-828d56ce3393 HTTP/1.1 Apr 17 10:53:14 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:53:14 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:53:14 user devstack@n-api.service[72743]: Connection: close Apr 17 10:53:14 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:53:14 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:53:14 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:53:14 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:53:14 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:53:14 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSCx__KUye5c5Uk1RXfpSnCpy1lFvFSvuM0sqOq3yjGM_kIZ6rog0pzp377pLuUEu0MKOwWfAyxQsyqbyJTO9toZgftEDYYUD_kO00bm1Cv0DJ1s6ltCoIXj-DHCi0Gg2bhQ1w34NOyeyRqGGzjl0Y5w3hATzQKxADNewisDJmiiGoQ Apr 17 10:53:14 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:53:14 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:53:14 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:53:14 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:53:14 user devstack@n-api.service[72743]: X-Openstack-Nova-Api-Version: 2.87 Apr 17 10:53:14 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:53:14 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:53:14 user devstack@n-api.service[72743]: X-Project-Id: faab4afa0ddf45578232627c2fac2ff8 Apr 17 10:53:14 user devstack@n-api.service[72743]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-933538997 Apr 17 10:53:14 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:53:14 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:53:14 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/faab4afa0ddf45578232627c2fac2ff8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/faab4afa0ddf45578232627c2fac2ff8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/faab4afa0ddf45578232627c2fac2ff8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:53:14 user devstack@n-api.service[72743]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-933538997 Apr 17 10:53:14 user devstack@n-api.service[72743]: X-Tenant-Id: faab4afa0ddf45578232627c2fac2ff8 Apr 17 10:53:14 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-933538997 Apr 17 10:53:14 user devstack@n-api.service[72743]: X-User: tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member Apr 17 10:53:14 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:53:14 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:53:14 user devstack@n-api.service[72743]: X-User-Id: d8cb73d24d324903a625e4782270120e Apr 17 10:53:14 user devstack@n-api.service[72743]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member Apr 17 10:53:14 user devstack@n-api.service[72743]: method: > Apr 17 10:53:14 user devstack@n-api.service[72743]: exception: Instance e198ad00-927f-45e1-9f14-828d56ce3393 could not be found. Apr 17 10:53:14 user devstack@n-api.service[72743]: action_args: {'id': 'e198ad00-927f-45e1-9f14-828d56ce3393'} Apr 17 10:53:14 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e198ad00-927f-45e1-9f14-828d56ce3393 could not be found. Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e198ad00-927f-45e1-9f14-828d56ce3393 could not be found. Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e198ad00-927f-45e1-9f14-828d56ce3393 could not be found. Apr 17 10:53:14 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:53:14 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b2b7e259-c0a7-4bc2-81d3-f67ccef51ca1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Returning 404 to user: Instance e198ad00-927f-45e1-9f14-828d56ce3393 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:53:14 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-b2b7e259-c0a7-4bc2-81d3-f67ccef51ca1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e198ad00-927f-45e1-9f14-828d56ce3393" status: 404 len: 111 microversion: 2.87 time: 0.029121 Apr 17 10:53:14 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 258/764] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:53:14 2023] GET /compute/v2.1/servers/e198ad00-927f-45e1-9f14-828d56ce3393 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 10:53:14 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:53:14 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:53:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:14 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Going to try to terminate instance {{(pid=72744) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:53:14 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-fed82e2b-dd0a-471f-85c0-7d74eecb76eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f" status: 204 len: 0 microversion: 2.87 time: 0.111735 Apr 17 10:53:14 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 245/765] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 17 10:53:14 2023] DELETE /compute/v2.1/servers/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 17 10:53:14 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-956c9039-526a-463c-8d61-63f5d1122f1f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:53:14 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-956c9039-526a-463c-8d61-63f5d1122f1f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:53:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-956c9039-526a-463c-8d61-63f5d1122f1f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-956c9039-526a-463c-8d61-63f5d1122f1f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-956c9039-526a-463c-8d61-63f5d1122f1f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-956c9039-526a-463c-8d61-63f5d1122f1f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-956c9039-526a-463c-8d61-63f5d1122f1f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-956c9039-526a-463c-8d61-63f5d1122f1f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:14 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-956c9039-526a-463c-8d61-63f5d1122f1f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:53:14 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-956c9039-526a-463c-8d61-63f5d1122f1f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:53:14 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-956c9039-526a-463c-8d61-63f5d1122f1f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:53:14 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-956c9039-526a-463c-8d61-63f5d1122f1f tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f" status: 200 len: 1697 microversion: 2.87 time: 0.294103 Apr 17 10:53:14 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 263/766] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:53:14 2023] GET /compute/v2.1/servers/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f => generated 1697 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:53:15 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-3a472cb2-bd94-45cb-88e5-2193cf8f5d30 req-84eacfe9-54ee-4116-b5ce-f4d961bbd8dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0deb56c2-1224-488f-9d30-4082ec677dc7", "name": "network-vif-plugged", "status": "completed", "tag": "0464e1cc-c5eb-4e76-be88-393898a80f3b"}, {"server_uuid": "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f", "name": "network-vif-unplugged", "status": "completed", "tag": "141b2515-71aa-446f-9310-724be1ed6626"}, {"server_uuid": "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f", "name": "network-vif-plugged", "status": "completed", "tag": "141b2515-71aa-446f-9310-724be1ed6626"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:53:15 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-3a472cb2-bd94-45cb-88e5-2193cf8f5d30 req-84eacfe9-54ee-4116-b5ce-f4d961bbd8dc service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:15 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-3a472cb2-bd94-45cb-88e5-2193cf8f5d30 req-84eacfe9-54ee-4116-b5ce-f4d961bbd8dc service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:15 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-3a472cb2-bd94-45cb-88e5-2193cf8f5d30 req-84eacfe9-54ee-4116-b5ce-f4d961bbd8dc service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:15 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-3a472cb2-bd94-45cb-88e5-2193cf8f5d30 req-84eacfe9-54ee-4116-b5ce-f4d961bbd8dc service nova] Creating event network-vif-plugged:0464e1cc-c5eb-4e76-be88-393898a80f3b for instance 0deb56c2-1224-488f-9d30-4082ec677dc7 on user Apr 17 10:53:15 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-3a472cb2-bd94-45cb-88e5-2193cf8f5d30 req-84eacfe9-54ee-4116-b5ce-f4d961bbd8dc service nova] Creating event network-vif-unplugged:141b2515-71aa-446f-9310-724be1ed6626 for instance 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f on user Apr 17 10:53:15 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-3a472cb2-bd94-45cb-88e5-2193cf8f5d30 req-84eacfe9-54ee-4116-b5ce-f4d961bbd8dc service nova] Creating event network-vif-plugged:141b2515-71aa-446f-9310-724be1ed6626 for instance 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f on user Apr 17 10:53:15 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-3a472cb2-bd94-45cb-88e5-2193cf8f5d30 req-84eacfe9-54ee-4116-b5ce-f4d961bbd8dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.043492 Apr 17 10:53:15 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 259/767] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:53:15 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:53:15 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-3c0e444d-e728-48e8-ba13-5c2fcbf313e7 req-0d5b8953-cebe-4196-a0f2-632544415012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f", "name": "network-vif-deleted", "tag": "141b2515-71aa-446f-9310-724be1ed6626"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:53:15 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-3c0e444d-e728-48e8-ba13-5c2fcbf313e7 req-0d5b8953-cebe-4196-a0f2-632544415012 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:15 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-3c0e444d-e728-48e8-ba13-5c2fcbf313e7 req-0d5b8953-cebe-4196-a0f2-632544415012 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:15 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-3c0e444d-e728-48e8-ba13-5c2fcbf313e7 req-0d5b8953-cebe-4196-a0f2-632544415012 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:15 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-3c0e444d-e728-48e8-ba13-5c2fcbf313e7 req-0d5b8953-cebe-4196-a0f2-632544415012 service nova] Creating event network-vif-deleted:141b2515-71aa-446f-9310-724be1ed6626 for instance 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f on user Apr 17 10:53:15 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-3c0e444d-e728-48e8-ba13-5c2fcbf313e7 req-0d5b8953-cebe-4196-a0f2-632544415012 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031087 Apr 17 10:53:15 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 246/768] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:53:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:53:40 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:53:40 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:53:40 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=16 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:53:40 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:53:40 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:53:40 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=20 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:53:40 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=33,nova_cell1:INSERT=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:53:40 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-063f93ff-189a-43ef-b78a-fcab7a16fc3e tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:53:40 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-063f93ff-189a-43ef-b78a-fcab7a16fc3e tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:53:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-063f93ff-189a-43ef-b78a-fcab7a16fc3e tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-063f93ff-189a-43ef-b78a-fcab7a16fc3e tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-063f93ff-189a-43ef-b78a-fcab7a16fc3e tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-063f93ff-189a-43ef-b78a-fcab7a16fc3e tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-063f93ff-189a-43ef-b78a-fcab7a16fc3e tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-063f93ff-189a-43ef-b78a-fcab7a16fc3e tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:40 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-063f93ff-189a-43ef-b78a-fcab7a16fc3e tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] HTTP exception thrown: Instance 38871910-281e-4aea-9343-79aed3f3b1b9 could not be found. Apr 17 10:53:40 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-063f93ff-189a-43ef-b78a-fcab7a16fc3e tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Request method failure captured: Apr 17 10:53:40 user devstack@n-api.service[72743]: request: GET /compute/v2.1/servers/38871910-281e-4aea-9343-79aed3f3b1b9 HTTP/1.1 Apr 17 10:53:40 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:53:40 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:53:40 user devstack@n-api.service[72743]: Connection: close Apr 17 10:53:40 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:53:40 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:53:40 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:53:40 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:53:40 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSSCVaY1iKFmkIuE91AAZWbZr-St_d2GFFrNXSeGSoQiDrm-J9xeGchCURDcBT2f6OJKR7j1O2xqpvL6Q1v7RUTS6S0coDZzk4yo8dpwf8dH_RMLU-Nova4o6mAYcBGkp1ZyRONF4za9zTxaNNTE8dZP8s8iS--XIiCu-N56JXP7Shg Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Project-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Project-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Tenant: tempest-TestVolumeBootPattern-1777404437 Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Tenant-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 10:53:40 user devstack@n-api.service[72743]: X-User: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 10:53:40 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:53:40 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:53:40 user devstack@n-api.service[72743]: X-User-Id: 0e4ed1192974484bba2d4392f4d011c2 Apr 17 10:53:40 user devstack@n-api.service[72743]: X-User-Name: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 10:53:40 user devstack@n-api.service[72743]: method: > Apr 17 10:53:40 user devstack@n-api.service[72743]: exception: Instance 38871910-281e-4aea-9343-79aed3f3b1b9 could not be found. Apr 17 10:53:40 user devstack@n-api.service[72743]: action_args: {'id': '38871910-281e-4aea-9343-79aed3f3b1b9'} Apr 17 10:53:40 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38871910-281e-4aea-9343-79aed3f3b1b9 could not be found. Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38871910-281e-4aea-9343-79aed3f3b1b9 could not be found. Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38871910-281e-4aea-9343-79aed3f3b1b9 could not be found. Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:53:40 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-063f93ff-189a-43ef-b78a-fcab7a16fc3e tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Returning 404 to user: Instance 38871910-281e-4aea-9343-79aed3f3b1b9 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:53:40 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-063f93ff-189a-43ef-b78a-fcab7a16fc3e tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38871910-281e-4aea-9343-79aed3f3b1b9" status: 404 len: 111 microversion: 2.1 time: 0.039265 Apr 17 10:53:40 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 260/769] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:53:40 2023] GET /compute/v2.1/servers/38871910-281e-4aea-9343-79aed3f3b1b9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:53:40 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-b45bc9f9-5dd9-413c-b986-5d499c53186f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:53:40 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-b45bc9f9-5dd9-413c-b986-5d499c53186f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:53:40 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:53:40 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:53:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b45bc9f9-5dd9-413c-b986-5d499c53186f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b45bc9f9-5dd9-413c-b986-5d499c53186f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b45bc9f9-5dd9-413c-b986-5d499c53186f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b45bc9f9-5dd9-413c-b986-5d499c53186f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b45bc9f9-5dd9-413c-b986-5d499c53186f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:40 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-7a761005-32d7-438c-b1ba-6ce106b2dd73 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:53:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b45bc9f9-5dd9-413c-b986-5d499c53186f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:40 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-7a761005-32d7-438c-b1ba-6ce106b2dd73 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:53:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7a761005-32d7-438c-b1ba-6ce106b2dd73 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7a761005-32d7-438c-b1ba-6ce106b2dd73 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7a761005-32d7-438c-b1ba-6ce106b2dd73 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7a761005-32d7-438c-b1ba-6ce106b2dd73 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7a761005-32d7-438c-b1ba-6ce106b2dd73 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7a761005-32d7-438c-b1ba-6ce106b2dd73 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:40 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-b45bc9f9-5dd9-413c-b986-5d499c53186f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.206452 Apr 17 10:53:40 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 264/770] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:53:40 2023] GET /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315/os-volume_attachments => generated 25 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 17 10:53:40 user devstack@n-api.service[72744]: INFO nova.api.openstack.wsgi [None req-7a761005-32d7-438c-b1ba-6ce106b2dd73 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] HTTP exception thrown: Instance 38871910-281e-4aea-9343-79aed3f3b1b9 could not be found. Apr 17 10:53:40 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-7a761005-32d7-438c-b1ba-6ce106b2dd73 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Request method failure captured: Apr 17 10:53:40 user devstack@n-api.service[72744]: request: DELETE /compute/v2.1/servers/38871910-281e-4aea-9343-79aed3f3b1b9 HTTP/1.1 Apr 17 10:53:40 user devstack@n-api.service[72744]: Accept: application/json Apr 17 10:53:40 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 10:53:40 user devstack@n-api.service[72744]: Connection: close Apr 17 10:53:40 user devstack@n-api.service[72744]: Content-Length: 0 Apr 17 10:53:40 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 10:53:40 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 10:53:40 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 10:53:40 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 10:53:40 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSSCVaY1iKFmkIuE91AAZWbZr-St_d2GFFrNXSeGSoQiDrm-J9xeGchCURDcBT2f6OJKR7j1O2xqpvL6Q1v7RUTS6S0coDZzk4yo8dpwf8dH_RMLU-Nova4o6mAYcBGkp1ZyRONF4za9zTxaNNTE8dZP8s8iS--XIiCu-N56JXP7Shg Apr 17 10:53:40 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 10:53:40 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 10:53:40 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 10:53:40 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 10:53:40 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 10:53:40 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 10:53:40 user devstack@n-api.service[72744]: X-Project-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 10:53:40 user devstack@n-api.service[72744]: X-Project-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 10:53:40 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 10:53:40 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 10:53:40 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:53:40 user devstack@n-api.service[72744]: X-Tenant: tempest-TestVolumeBootPattern-1777404437 Apr 17 10:53:40 user devstack@n-api.service[72744]: X-Tenant-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 10:53:40 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 10:53:40 user devstack@n-api.service[72744]: X-User: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 10:53:40 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 10:53:40 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 10:53:40 user devstack@n-api.service[72744]: X-User-Id: 0e4ed1192974484bba2d4392f4d011c2 Apr 17 10:53:40 user devstack@n-api.service[72744]: X-User-Name: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 10:53:40 user devstack@n-api.service[72744]: method: > Apr 17 10:53:40 user devstack@n-api.service[72744]: exception: Instance 38871910-281e-4aea-9343-79aed3f3b1b9 could not be found. Apr 17 10:53:40 user devstack@n-api.service[72744]: action_args: {'id': '38871910-281e-4aea-9343-79aed3f3b1b9'} Apr 17 10:53:40 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38871910-281e-4aea-9343-79aed3f3b1b9 could not be found. Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38871910-281e-4aea-9343-79aed3f3b1b9 could not be found. Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38871910-281e-4aea-9343-79aed3f3b1b9 could not be found. Apr 17 10:53:40 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:53:40 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-7a761005-32d7-438c-b1ba-6ce106b2dd73 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Returning 404 to user: Instance 38871910-281e-4aea-9343-79aed3f3b1b9 could not be found. {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:53:40 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-7a761005-32d7-438c-b1ba-6ce106b2dd73 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/38871910-281e-4aea-9343-79aed3f3b1b9" status: 404 len: 111 microversion: 2.1 time: 0.037676 Apr 17 10:53:40 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 247/771] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:53:40 2023] DELETE /compute/v2.1/servers/38871910-281e-4aea-9343-79aed3f3b1b9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:53:40 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-1203bbaf-e627-4e49-901f-cca5e0421df1 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:53:40 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-1203bbaf-e627-4e49-901f-cca5e0421df1 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 38871910-281e-4aea-9343-79aed3f3b1b9] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:53:40 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-7992c0f3-e153-4a19-81af-f8b15b44aa7d tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:53:40 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-7992c0f3-e153-4a19-81af-f8b15b44aa7d tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:53:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1203bbaf-e627-4e49-901f-cca5e0421df1 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1203bbaf-e627-4e49-901f-cca5e0421df1 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1203bbaf-e627-4e49-901f-cca5e0421df1 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7992c0f3-e153-4a19-81af-f8b15b44aa7d tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7992c0f3-e153-4a19-81af-f8b15b44aa7d tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1203bbaf-e627-4e49-901f-cca5e0421df1 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7992c0f3-e153-4a19-81af-f8b15b44aa7d tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1203bbaf-e627-4e49-901f-cca5e0421df1 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1203bbaf-e627-4e49-901f-cca5e0421df1 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7992c0f3-e153-4a19-81af-f8b15b44aa7d tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7992c0f3-e153-4a19-81af-f8b15b44aa7d tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7992c0f3-e153-4a19-81af-f8b15b44aa7d tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:40 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-1203bbaf-e627-4e49-901f-cca5e0421df1 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] HTTP exception thrown: Instance 38871910-281e-4aea-9343-79aed3f3b1b9 could not be found. Apr 17 10:53:40 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-1203bbaf-e627-4e49-901f-cca5e0421df1 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Request method failure captured: Apr 17 10:53:40 user devstack@n-api.service[72745]: request: GET /compute/v2.1/servers/38871910-281e-4aea-9343-79aed3f3b1b9 HTTP/1.1 Apr 17 10:53:40 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:53:40 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:53:40 user devstack@n-api.service[72745]: Connection: close Apr 17 10:53:40 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 10:53:40 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:53:40 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:53:40 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:53:40 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:53:40 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSSCVaY1iKFmkIuE91AAZWbZr-St_d2GFFrNXSeGSoQiDrm-J9xeGchCURDcBT2f6OJKR7j1O2xqpvL6Q1v7RUTS6S0coDZzk4yo8dpwf8dH_RMLU-Nova4o6mAYcBGkp1ZyRONF4za9zTxaNNTE8dZP8s8iS--XIiCu-N56JXP7Shg Apr 17 10:53:40 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:53:40 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:53:40 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:53:40 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:53:40 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:53:40 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:53:40 user devstack@n-api.service[72745]: X-Project-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 10:53:40 user devstack@n-api.service[72745]: X-Project-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 10:53:40 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:53:40 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:53:40 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:53:40 user devstack@n-api.service[72745]: X-Tenant: tempest-TestVolumeBootPattern-1777404437 Apr 17 10:53:40 user devstack@n-api.service[72745]: X-Tenant-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 10:53:40 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 10:53:40 user devstack@n-api.service[72745]: X-User: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 10:53:40 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:53:40 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:53:40 user devstack@n-api.service[72745]: X-User-Id: 0e4ed1192974484bba2d4392f4d011c2 Apr 17 10:53:40 user devstack@n-api.service[72745]: X-User-Name: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 10:53:40 user devstack@n-api.service[72745]: method: > Apr 17 10:53:40 user devstack@n-api.service[72745]: exception: Instance 38871910-281e-4aea-9343-79aed3f3b1b9 could not be found. Apr 17 10:53:40 user devstack@n-api.service[72745]: action_args: {'id': '38871910-281e-4aea-9343-79aed3f3b1b9'} Apr 17 10:53:40 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38871910-281e-4aea-9343-79aed3f3b1b9 could not be found. Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38871910-281e-4aea-9343-79aed3f3b1b9 could not be found. Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38871910-281e-4aea-9343-79aed3f3b1b9 could not be found. Apr 17 10:53:40 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:53:40 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-1203bbaf-e627-4e49-901f-cca5e0421df1 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Returning 404 to user: Instance 38871910-281e-4aea-9343-79aed3f3b1b9 could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:53:40 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-1203bbaf-e627-4e49-901f-cca5e0421df1 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38871910-281e-4aea-9343-79aed3f3b1b9" status: 404 len: 111 microversion: 2.1 time: 0.025412 Apr 17 10:53:40 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 265/772] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:53:40 2023] GET /compute/v2.1/servers/38871910-281e-4aea-9343-79aed3f3b1b9 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:53:40 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-7992c0f3-e153-4a19-81af-f8b15b44aa7d tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] HTTP exception thrown: Instance 3fd89020-5492-4e40-a911-63f9b1b43315 is not attached to volume 0f4bbb72-51fe-46f3-a970-cb6f934f63f3 Apr 17 10:53:40 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-7992c0f3-e153-4a19-81af-f8b15b44aa7d tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Request method failure captured: Apr 17 10:53:40 user devstack@n-api.service[72743]: request: DELETE /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315/os-volume_attachments/0f4bbb72-51fe-46f3-a970-cb6f934f63f3 HTTP/1.1 Apr 17 10:53:40 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:53:40 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:53:40 user devstack@n-api.service[72743]: Connection: close Apr 17 10:53:40 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:53:40 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:53:40 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:53:40 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:53:40 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSP-BtSOnsyB6KCaTxrrgInwl952BD18h9y51bwpAjWCA4Hbw1ASyPBLVrH2legVLq48N7IHlYA6cu4Ku2IXDLWK2ZiMfyI2VKOhTFw2CQ0qtXeShRjPK1bZ0whL7jFPD2oxtfVkX2pocE_tUozBhIsfCRD5HOWhpbvxnT2lby50mMU Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Project-Id: 455ea6870abe450ba413ffabf4d4097e Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Project-Name: tempest-TestMinimumBasicScenario-1309632250 Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/455ea6870abe450ba413ffabf4d4097e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/455ea6870abe450ba413ffabf4d4097e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/455ea6870abe450ba413ffabf4d4097e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Tenant: tempest-TestMinimumBasicScenario-1309632250 Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Tenant-Id: 455ea6870abe450ba413ffabf4d4097e Apr 17 10:53:40 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1309632250 Apr 17 10:53:40 user devstack@n-api.service[72743]: X-User: tempest-TestMinimumBasicScenario-1309632250-project-member Apr 17 10:53:40 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:53:40 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:53:40 user devstack@n-api.service[72743]: X-User-Id: df693038f49145b9854ae18d246dde2f Apr 17 10:53:40 user devstack@n-api.service[72743]: X-User-Name: tempest-TestMinimumBasicScenario-1309632250-project-member Apr 17 10:53:40 user devstack@n-api.service[72743]: method: > Apr 17 10:53:40 user devstack@n-api.service[72743]: exception: Instance 3fd89020-5492-4e40-a911-63f9b1b43315 is not attached to volume 0f4bbb72-51fe-46f3-a970-cb6f934f63f3 Apr 17 10:53:40 user devstack@n-api.service[72743]: action_args: {'server_id': '3fd89020-5492-4e40-a911-63f9b1b43315', 'id': '0f4bbb72-51fe-46f3-a970-cb6f934f63f3'} Apr 17 10:53:40 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0f4bbb72-51fe-46f3-a970-cb6f934f63f3. Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fd89020-5492-4e40-a911-63f9b1b43315 is not attached to volume 0f4bbb72-51fe-46f3-a970-cb6f934f63f3 Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fd89020-5492-4e40-a911-63f9b1b43315 is not attached to volume 0f4bbb72-51fe-46f3-a970-cb6f934f63f3 Apr 17 10:53:40 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:53:40 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-7992c0f3-e153-4a19-81af-f8b15b44aa7d tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Returning 404 to user: Instance 3fd89020-5492-4e40-a911-63f9b1b43315 is not attached to volume 0f4bbb72-51fe-46f3-a970-cb6f934f63f3 {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:53:40 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-7992c0f3-e153-4a19-81af-f8b15b44aa7d tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315/os-volume_attachments/0f4bbb72-51fe-46f3-a970-cb6f934f63f3" status: 404 len: 154 microversion: 2.1 time: 0.105051 Apr 17 10:53:40 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 261/773] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Apr 17 10:53:40 2023] DELETE /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315/os-volume_attachments/0f4bbb72-51fe-46f3-a970-cb6f934f63f3 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 17 10:53:44 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:53:44 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:53:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:44 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Going to try to terminate instance {{(pid=72744) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:53:44 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-593e603e-2583-450f-9e54-0e8cc193e053 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315" status: 204 len: 0 microversion: 2.1 time: 0.126383 Apr 17 10:53:44 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 248/774] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:53:44 2023] DELETE /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:53:44 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-a3cee3ac-3728-427f-81cb-e430885b0749 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:53:44 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-a3cee3ac-3728-427f-81cb-e430885b0749 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:53:44 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a3cee3ac-3728-427f-81cb-e430885b0749 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:44 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a3cee3ac-3728-427f-81cb-e430885b0749 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:44 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a3cee3ac-3728-427f-81cb-e430885b0749 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:44 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a3cee3ac-3728-427f-81cb-e430885b0749 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:44 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a3cee3ac-3728-427f-81cb-e430885b0749 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:44 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a3cee3ac-3728-427f-81cb-e430885b0749 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:44 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-1bed7c15-e25a-4b71-bf6d-5e31cc73c947 req-c776a26b-cb44-4e92-93ca-30a5df511751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd89020-5492-4e40-a911-63f9b1b43315", "name": "network-vif-unplugged", "status": "completed", "tag": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:53:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-1bed7c15-e25a-4b71-bf6d-5e31cc73c947 req-c776a26b-cb44-4e92-93ca-30a5df511751 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-1bed7c15-e25a-4b71-bf6d-5e31cc73c947 req-c776a26b-cb44-4e92-93ca-30a5df511751 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-1bed7c15-e25a-4b71-bf6d-5e31cc73c947 req-c776a26b-cb44-4e92-93ca-30a5df511751 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:44 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-a3cee3ac-3728-427f-81cb-e430885b0749 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df693038f49145b9854ae18d246dde2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455ea6870abe450ba413ffabf4d4097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:53:44 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-1bed7c15-e25a-4b71-bf6d-5e31cc73c947 req-c776a26b-cb44-4e92-93ca-30a5df511751 service nova] Creating event network-vif-unplugged:65f23819-ccfb-4eb0-adc1-3f9895ed9c39 for instance 3fd89020-5492-4e40-a911-63f9b1b43315 on user Apr 17 10:53:44 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-a3cee3ac-3728-427f-81cb-e430885b0749 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315" status: 200 len: 1541 microversion: 2.1 time: 0.281458 Apr 17 10:53:44 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 266/775] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:53:44 2023] GET /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315 => generated 1541 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:53:44 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-1bed7c15-e25a-4b71-bf6d-5e31cc73c947 req-c776a26b-cb44-4e92-93ca-30a5df511751 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034783 Apr 17 10:53:44 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 262/776] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:53:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:53:45 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-729ae7e3-6e32-41b7-836f-8f0e47e63a3a req-def7600e-16f7-451e-b701-24acc2d38215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd89020-5492-4e40-a911-63f9b1b43315", "name": "network-vif-deleted", "tag": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:53:45 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-729ae7e3-6e32-41b7-836f-8f0e47e63a3a req-def7600e-16f7-451e-b701-24acc2d38215 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:45 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-729ae7e3-6e32-41b7-836f-8f0e47e63a3a req-def7600e-16f7-451e-b701-24acc2d38215 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:45 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-729ae7e3-6e32-41b7-836f-8f0e47e63a3a req-def7600e-16f7-451e-b701-24acc2d38215 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:45 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-729ae7e3-6e32-41b7-836f-8f0e47e63a3a req-def7600e-16f7-451e-b701-24acc2d38215 service nova] Creating event network-vif-deleted:65f23819-ccfb-4eb0-adc1-3f9895ed9c39 for instance 3fd89020-5492-4e40-a911-63f9b1b43315 on user Apr 17 10:53:45 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-729ae7e3-6e32-41b7-836f-8f0e47e63a3a req-def7600e-16f7-451e-b701-24acc2d38215 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030314 Apr 17 10:53:45 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 249/777] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:53:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:53:46 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-61a45454-3da5-4500-8e50-786af4e35d6a req-667354af-0243-4aa2-87b5-b943325d3824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd89020-5492-4e40-a911-63f9b1b43315", "name": "network-vif-plugged", "status": "completed", "tag": "65f23819-ccfb-4eb0-adc1-3f9895ed9c39"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:53:46 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-61a45454-3da5-4500-8e50-786af4e35d6a req-667354af-0243-4aa2-87b5-b943325d3824 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:46 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-61a45454-3da5-4500-8e50-786af4e35d6a req-667354af-0243-4aa2-87b5-b943325d3824 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:46 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-61a45454-3da5-4500-8e50-786af4e35d6a req-667354af-0243-4aa2-87b5-b943325d3824 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:46 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-61a45454-3da5-4500-8e50-786af4e35d6a req-667354af-0243-4aa2-87b5-b943325d3824 service nova] Creating event network-vif-plugged:65f23819-ccfb-4eb0-adc1-3f9895ed9c39 for instance 3fd89020-5492-4e40-a911-63f9b1b43315 on user Apr 17 10:53:46 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-61a45454-3da5-4500-8e50-786af4e35d6a req-667354af-0243-4aa2-87b5-b943325d3824 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027210 Apr 17 10:53:46 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 267/778] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:53:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:53:52 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1214588522", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "f9878792-e314-42e2-8384-f3175679bfb9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b2fc1cd4-860e-4abd-8e33-e797799c466f"}]}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:53:52 user devstack@n-api.service[72743]: DEBUG nova.network.neutron [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] validate_networks() for [('b2fc1cd4-860e-4abd-8e33-e797799c466f', None, None, None, None, None)] {{(pid=72743) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:53:52 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flavor limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:53:52 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Image limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:53:52 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flavor pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:53:52 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Image pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:53:52 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:53:52 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:52 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:52 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:52 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:52 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:52 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:52 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Getting quotas for project 4fc3b8e3925847d48b522206a8875d3f. Resources: {'cores', 'instances', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:53:53 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Getting quotas for user 0e4ed1192974484bba2d4392f4d011c2 and project 4fc3b8e3925847d48b522206a8875d3f. Resources: {'cores', 'instances', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:53:53 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Going to run 1 instances... {{(pid=72743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:53:53 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f9878792-e314-42e2-8384-f3175679bfb9',volume_size=None,volume_type=None)] {{(pid=72743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:53:53 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-b892fd3b-d323-4126-ae39-70d97abb50a7 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.752744 Apr 17 10:53:53 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 263/779] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:53:52 2023] POST /compute/v2.1/servers => generated 378 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 17 10:53:53 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-2118b004-cdc0-4cb0-8a58-09c3c2359133 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:53:53 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-2118b004-cdc0-4cb0-8a58-09c3c2359133 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:53:53 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-2118b004-cdc0-4cb0-8a58-09c3c2359133 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:53:53 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-2118b004-cdc0-4cb0-8a58-09c3c2359133 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/109ee5e0-8c02-43c2-9415-48bb0c8c3a06" status: 200 len: 1066 microversion: 2.1 time: 0.060843 Apr 17 10:53:53 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 250/780] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:53:53 2023] GET /compute/v2.1/servers/109ee5e0-8c02-43c2-9415-48bb0c8c3a06 => generated 1066 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:53:55 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-2747a63f-99bd-435f-9884-c3cccf1af39b req-b6869289-5e4a-473b-b62d-2475ac39a89d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "109ee5e0-8c02-43c2-9415-48bb0c8c3a06", "tag": "d4f89575-0631-4344-ac9f-dfb2211df9a0"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:53:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-2747a63f-99bd-435f-9884-c3cccf1af39b req-b6869289-5e4a-473b-b62d-2475ac39a89d service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-2747a63f-99bd-435f-9884-c3cccf1af39b req-b6869289-5e4a-473b-b62d-2475ac39a89d service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-2747a63f-99bd-435f-9884-c3cccf1af39b req-b6869289-5e4a-473b-b62d-2475ac39a89d service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:55 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-2747a63f-99bd-435f-9884-c3cccf1af39b req-b6869289-5e4a-473b-b62d-2475ac39a89d service nova] Creating event network-changed:d4f89575-0631-4344-ac9f-dfb2211df9a0 for instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 on user Apr 17 10:53:55 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-2747a63f-99bd-435f-9884-c3cccf1af39b req-b6869289-5e4a-473b-b62d-2475ac39a89d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027681 Apr 17 10:53:55 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 268/781] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:53:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:53:58 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-46c60e9e-b23e-4d5e-818c-86d8c67a2dde tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:53:58 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-46c60e9e-b23e-4d5e-818c-86d8c67a2dde tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:53:58 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-46c60e9e-b23e-4d5e-818c-86d8c67a2dde tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:58 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-46c60e9e-b23e-4d5e-818c-86d8c67a2dde tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:58 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-46c60e9e-b23e-4d5e-818c-86d8c67a2dde tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:58 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-46c60e9e-b23e-4d5e-818c-86d8c67a2dde tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:53:58 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-46c60e9e-b23e-4d5e-818c-86d8c67a2dde tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:53:58 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-46c60e9e-b23e-4d5e-818c-86d8c67a2dde tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:53:59 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-46c60e9e-b23e-4d5e-818c-86d8c67a2dde tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad2b6b478547e78e2cf273ef0390ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652f9a7f20954e23b143e349c538f418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:53:59 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-46c60e9e-b23e-4d5e-818c-86d8c67a2dde tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0deb56c2-1224-488f-9d30-4082ec677dc7" status: 200 len: 1497 microversion: 2.1 time: 0.260035 Apr 17 10:53:59 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 264/782] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:53:58 2023] GET /compute/v2.1/servers/0deb56c2-1224-488f-9d30-4082ec677dc7 => generated 1497 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:54:01 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-fbbf4821-530e-4d3b-982d-584da122fd60 req-a9cac340-a382-4150-ab9b-a00c074de683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "109ee5e0-8c02-43c2-9415-48bb0c8c3a06", "name": "network-vif-plugged", "status": "completed", "tag": "d4f89575-0631-4344-ac9f-dfb2211df9a0"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:54:01 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-fbbf4821-530e-4d3b-982d-584da122fd60 req-a9cac340-a382-4150-ab9b-a00c074de683 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-fbbf4821-530e-4d3b-982d-584da122fd60 req-a9cac340-a382-4150-ab9b-a00c074de683 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:01 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-fbbf4821-530e-4d3b-982d-584da122fd60 req-a9cac340-a382-4150-ab9b-a00c074de683 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:01 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-fbbf4821-530e-4d3b-982d-584da122fd60 req-a9cac340-a382-4150-ab9b-a00c074de683 service nova] Creating event network-vif-plugged:d4f89575-0631-4344-ac9f-dfb2211df9a0 for instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 on user Apr 17 10:54:01 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-fbbf4821-530e-4d3b-982d-584da122fd60 req-a9cac340-a382-4150-ab9b-a00c074de683 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035228 Apr 17 10:54:01 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 251/783] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:54:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:54:03 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-411694eb-bc73-42c6-b7af-14ccca975a67 req-b0d986dd-8e7a-4bb8-9ff3-4041b1cefaba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "109ee5e0-8c02-43c2-9415-48bb0c8c3a06", "name": "network-vif-plugged", "status": "completed", "tag": "d4f89575-0631-4344-ac9f-dfb2211df9a0"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:54:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-411694eb-bc73-42c6-b7af-14ccca975a67 req-b0d986dd-8e7a-4bb8-9ff3-4041b1cefaba service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-411694eb-bc73-42c6-b7af-14ccca975a67 req-b0d986dd-8e7a-4bb8-9ff3-4041b1cefaba service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-411694eb-bc73-42c6-b7af-14ccca975a67 req-b0d986dd-8e7a-4bb8-9ff3-4041b1cefaba service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:03 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-411694eb-bc73-42c6-b7af-14ccca975a67 req-b0d986dd-8e7a-4bb8-9ff3-4041b1cefaba service nova] Creating event network-vif-plugged:d4f89575-0631-4344-ac9f-dfb2211df9a0 for instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 on user Apr 17 10:54:03 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-411694eb-bc73-42c6-b7af-14ccca975a67 req-b0d986dd-8e7a-4bb8-9ff3-4041b1cefaba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030985 Apr 17 10:54:03 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 269/784] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:54:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:54:04 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-7f029f80-5e1b-44db-a863-dc956313ad03 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:54:04 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-7f029f80-5e1b-44db-a863-dc956313ad03 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:54:04 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:04 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7f029f80-5e1b-44db-a863-dc956313ad03 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7f029f80-5e1b-44db-a863-dc956313ad03 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7f029f80-5e1b-44db-a863-dc956313ad03 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7f029f80-5e1b-44db-a863-dc956313ad03 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7f029f80-5e1b-44db-a863-dc956313ad03 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7f029f80-5e1b-44db-a863-dc956313ad03 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:04 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-7f029f80-5e1b-44db-a863-dc956313ad03 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] HTTP exception thrown: Instance 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f could not be found. Apr 17 10:54:04 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-7f029f80-5e1b-44db-a863-dc956313ad03 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Request method failure captured: Apr 17 10:54:04 user devstack@n-api.service[72743]: request: GET /compute/v2.1/servers/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f HTTP/1.1 Apr 17 10:54:04 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:54:04 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:54:04 user devstack@n-api.service[72743]: Connection: close Apr 17 10:54:04 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:54:04 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:54:04 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:54:04 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:54:04 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:54:04 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSCx__KUye5c5Uk1RXfpSnCpy1lFvFSvuM0sqOq3yjGM_kIZ6rog0pzp377pLuUEu0MKOwWfAyxQsyqbyJTO9toZgftEDYYUD_kO00bm1Cv0DJ1s6ltCoIXj-DHCi0Gg2bhQ1w34NOyeyRqGGzjl0Y5w3hATzQKxADNewisDJmiiGoQ Apr 17 10:54:04 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:54:04 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:54:04 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:54:04 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:54:04 user devstack@n-api.service[72743]: X-Openstack-Nova-Api-Version: 2.87 Apr 17 10:54:04 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:54:04 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:54:04 user devstack@n-api.service[72743]: X-Project-Id: faab4afa0ddf45578232627c2fac2ff8 Apr 17 10:54:04 user devstack@n-api.service[72743]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-933538997 Apr 17 10:54:04 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:54:04 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:54:04 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/faab4afa0ddf45578232627c2fac2ff8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/faab4afa0ddf45578232627c2fac2ff8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/faab4afa0ddf45578232627c2fac2ff8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:54:04 user devstack@n-api.service[72743]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-933538997 Apr 17 10:54:04 user devstack@n-api.service[72743]: X-Tenant-Id: faab4afa0ddf45578232627c2fac2ff8 Apr 17 10:54:04 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-933538997 Apr 17 10:54:04 user devstack@n-api.service[72743]: X-User: tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member Apr 17 10:54:04 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:54:04 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:54:04 user devstack@n-api.service[72743]: X-User-Id: d8cb73d24d324903a625e4782270120e Apr 17 10:54:04 user devstack@n-api.service[72743]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member Apr 17 10:54:04 user devstack@n-api.service[72743]: method: > Apr 17 10:54:04 user devstack@n-api.service[72743]: exception: Instance 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f could not be found. Apr 17 10:54:04 user devstack@n-api.service[72743]: action_args: {'id': '098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f'} Apr 17 10:54:04 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f could not be found. Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f could not be found. Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f could not be found. Apr 17 10:54:04 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:54:04 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-7f029f80-5e1b-44db-a863-dc956313ad03 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Returning 404 to user: Instance 098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:54:04 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-7f029f80-5e1b-44db-a863-dc956313ad03 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f" status: 404 len: 111 microversion: 2.87 time: 0.035560 Apr 17 10:54:04 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 265/785] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:54:04 2023] GET /compute/v2.1/servers/098c9d6b-df39-4ebe-80eb-4e3c5dadcf9f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 10:54:04 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:04 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:54:04 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:54:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:04 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Going to try to terminate instance {{(pid=72744) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:54:04 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-eed0283d-b050-4a16-9489-22d1d79e4b82 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" status: 204 len: 0 microversion: 2.87 time: 0.118519 Apr 17 10:54:04 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 252/786] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 17 10:54:04 2023] DELETE /compute/v2.1/servers/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 17 10:54:04 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-4e5cb6db-243b-4810-96d1-490bba48c76a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:54:04 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-4e5cb6db-243b-4810-96d1-490bba48c76a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:54:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4e5cb6db-243b-4810-96d1-490bba48c76a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4e5cb6db-243b-4810-96d1-490bba48c76a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4e5cb6db-243b-4810-96d1-490bba48c76a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4e5cb6db-243b-4810-96d1-490bba48c76a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4e5cb6db-243b-4810-96d1-490bba48c76a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4e5cb6db-243b-4810-96d1-490bba48c76a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:05 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-4e5cb6db-243b-4810-96d1-490bba48c76a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:54:05 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-4e5cb6db-243b-4810-96d1-490bba48c76a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:54:05 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-4e5cb6db-243b-4810-96d1-490bba48c76a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:54:05 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-4e5cb6db-243b-4810-96d1-490bba48c76a tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" status: 200 len: 1775 microversion: 2.87 time: 0.390737 Apr 17 10:54:05 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 270/787] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:54:04 2023] GET /compute/v2.1/servers/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab => generated 1775 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:54:05 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-32a8fa77-686c-4d75-85f6-bbc1c3ded56f req-509fbc31-1293-474d-9900-cd71f7ec8e7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab", "name": "network-vif-unplugged", "status": "completed", "tag": "2acfe658-2dce-4086-b24a-ef0b4c3714f8"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:54:05 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-32a8fa77-686c-4d75-85f6-bbc1c3ded56f req-509fbc31-1293-474d-9900-cd71f7ec8e7d service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:05 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-32a8fa77-686c-4d75-85f6-bbc1c3ded56f req-509fbc31-1293-474d-9900-cd71f7ec8e7d service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:05 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-32a8fa77-686c-4d75-85f6-bbc1c3ded56f req-509fbc31-1293-474d-9900-cd71f7ec8e7d service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:05 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-32a8fa77-686c-4d75-85f6-bbc1c3ded56f req-509fbc31-1293-474d-9900-cd71f7ec8e7d service nova] Creating event network-vif-unplugged:2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab on user Apr 17 10:54:05 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-32a8fa77-686c-4d75-85f6-bbc1c3ded56f req-509fbc31-1293-474d-9900-cd71f7ec8e7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042823 Apr 17 10:54:05 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 266/788] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:54:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 10:54:06 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-c7a08d5a-c2ec-44a2-8b9d-17fb00e90d96 req-9a2c8a5e-9e83-456c-999d-0f1252419351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab", "name": "network-vif-deleted", "tag": "2acfe658-2dce-4086-b24a-ef0b4c3714f8"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:54:06 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-c7a08d5a-c2ec-44a2-8b9d-17fb00e90d96 req-9a2c8a5e-9e83-456c-999d-0f1252419351 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:06 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-c7a08d5a-c2ec-44a2-8b9d-17fb00e90d96 req-9a2c8a5e-9e83-456c-999d-0f1252419351 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:06 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-c7a08d5a-c2ec-44a2-8b9d-17fb00e90d96 req-9a2c8a5e-9e83-456c-999d-0f1252419351 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:06 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-c7a08d5a-c2ec-44a2-8b9d-17fb00e90d96 req-9a2c8a5e-9e83-456c-999d-0f1252419351 service nova] Creating event network-vif-deleted:2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab on user Apr 17 10:54:06 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-c7a08d5a-c2ec-44a2-8b9d-17fb00e90d96 req-9a2c8a5e-9e83-456c-999d-0f1252419351 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038489 Apr 17 10:54:06 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 253/789] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:54:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:54:07 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-3d1cd7b5-9c01-4465-9395-d6d63be588f0 req-23bee5a8-5a3b-4167-b7bf-8e03ecc19fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab", "name": "network-vif-plugged", "status": "completed", "tag": "2acfe658-2dce-4086-b24a-ef0b4c3714f8"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:54:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-3d1cd7b5-9c01-4465-9395-d6d63be588f0 req-23bee5a8-5a3b-4167-b7bf-8e03ecc19fc6 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-3d1cd7b5-9c01-4465-9395-d6d63be588f0 req-23bee5a8-5a3b-4167-b7bf-8e03ecc19fc6 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-3d1cd7b5-9c01-4465-9395-d6d63be588f0 req-23bee5a8-5a3b-4167-b7bf-8e03ecc19fc6 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:07 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-3d1cd7b5-9c01-4465-9395-d6d63be588f0 req-23bee5a8-5a3b-4167-b7bf-8e03ecc19fc6 service nova] Creating event network-vif-plugged:2acfe658-2dce-4086-b24a-ef0b4c3714f8 for instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab on user Apr 17 10:54:07 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-3d1cd7b5-9c01-4465-9395-d6d63be588f0 req-23bee5a8-5a3b-4167-b7bf-8e03ecc19fc6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035081 Apr 17 10:54:07 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 271/790] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:54:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:54:07 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-c6b11f5d-f8cc-40f7-92bc-ba0aa9017002 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:54:07 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-c6b11f5d-f8cc-40f7-92bc-ba0aa9017002 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:54:07 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c6b11f5d-f8cc-40f7-92bc-ba0aa9017002 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:07 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c6b11f5d-f8cc-40f7-92bc-ba0aa9017002 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:07 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c6b11f5d-f8cc-40f7-92bc-ba0aa9017002 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:07 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c6b11f5d-f8cc-40f7-92bc-ba0aa9017002 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:07 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c6b11f5d-f8cc-40f7-92bc-ba0aa9017002 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:07 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c6b11f5d-f8cc-40f7-92bc-ba0aa9017002 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:07 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-c6b11f5d-f8cc-40f7-92bc-ba0aa9017002 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:54:07 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-c6b11f5d-f8cc-40f7-92bc-ba0aa9017002 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 200 len: 1675 microversion: 2.1 time: 0.234216 Apr 17 10:54:07 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 267/791] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:54:07 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 1675 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:54:07 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38ad981a-53cd-46a2-825a-78feacd3c702"}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:54:07 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:54:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:08 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-edd46402-afa9-4afd-856b-cbc00c4d6ab1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.388834 Apr 17 10:54:08 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 254/792] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Apr 17 10:54:07 2023] POST /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/os-volume_attachments => generated 194 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:54:15 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:54:15 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:54:15 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=19 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:15 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:15 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:15 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:15 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:15 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:15 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:15 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=29 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:15 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:54:15 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Old instance type m1.nano, new instance type m1.micro {{(pid=72745) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 17 10:54:15 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:15 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:15 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:15 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:15 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:15 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:15 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting quotas for project cc1b39ff9581474b87c58164e5cafa00. Resources: {'cores', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:54:15 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting quotas for user a7e218d771db49e88d13d3b088f3d88a and project cc1b39ff9581474b87c58164e5cafa00. Resources: {'cores', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:54:15 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flavor limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:54:15 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Image limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:54:15 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flavor pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:54:15 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Image pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:54:15 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:54:16 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-3375356b-5964-4b42-b82f-c44cd9279bcc tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/action" status: 202 len: 0 microversion: 2.1 time: 0.269664 Apr 17 10:54:16 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 272/793] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 10:54:15 2023] POST /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:54:16 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-0577b0ab-4b02-45b2-a70a-87e309947197 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:54:16 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-0577b0ab-4b02-45b2-a70a-87e309947197 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:54:16 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-0577b0ab-4b02-45b2-a70a-87e309947197 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-0577b0ab-4b02-45b2-a70a-87e309947197 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-0577b0ab-4b02-45b2-a70a-87e309947197 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-0577b0ab-4b02-45b2-a70a-87e309947197 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-0577b0ab-4b02-45b2-a70a-87e309947197 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-0577b0ab-4b02-45b2-a70a-87e309947197 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:16 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=29 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:16 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-0577b0ab-4b02-45b2-a70a-87e309947197 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:54:16 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-0577b0ab-4b02-45b2-a70a-87e309947197 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 200 len: 1730 microversion: 2.1 time: 0.223335 Apr 17 10:54:16 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 268/794] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:54:16 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 1730 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:54:18 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:18 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:18 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-7f8e678e-e37a-488c-8ee6-edf9e402f105 req-d58762c3-466c-43c1-a9c7-1c7f595af788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38", "name": "network-vif-unplugged", "status": "completed", "tag": "67386c8f-911d-4398-b449-42af25f6afe3"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:54:18 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-7f8e678e-e37a-488c-8ee6-edf9e402f105 req-d58762c3-466c-43c1-a9c7-1c7f595af788 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:18 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-7f8e678e-e37a-488c-8ee6-edf9e402f105 req-d58762c3-466c-43c1-a9c7-1c7f595af788 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:18 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-7f8e678e-e37a-488c-8ee6-edf9e402f105 req-d58762c3-466c-43c1-a9c7-1c7f595af788 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:18 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-7f8e678e-e37a-488c-8ee6-edf9e402f105 req-d58762c3-466c-43c1-a9c7-1c7f595af788 service nova] Creating event network-vif-unplugged:67386c8f-911d-4398-b449-42af25f6afe3 for instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 on user Apr 17 10:54:18 user devstack@n-api.service[72744]: DEBUG nova.compute.api [req-7f8e678e-e37a-488c-8ee6-edf9e402f105 req-d58762c3-466c-43c1-a9c7-1c7f595af788 service nova] Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72744) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 17 10:54:18 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-7f8e678e-e37a-488c-8ee6-edf9e402f105 req-d58762c3-466c-43c1-a9c7-1c7f595af788 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051452 Apr 17 10:54:18 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 255/795] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:54:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:54:20 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-4d4442ad-e722-45fe-82f3-37619ae7d046 req-2114ee50-e9e3-4583-b2ee-686ba6a5a50b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38", "name": "network-vif-plugged", "status": "completed", "tag": "67386c8f-911d-4398-b449-42af25f6afe3"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:54:20 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-4d4442ad-e722-45fe-82f3-37619ae7d046 req-2114ee50-e9e3-4583-b2ee-686ba6a5a50b service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:20 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-4d4442ad-e722-45fe-82f3-37619ae7d046 req-2114ee50-e9e3-4583-b2ee-686ba6a5a50b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:20 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-4d4442ad-e722-45fe-82f3-37619ae7d046 req-2114ee50-e9e3-4583-b2ee-686ba6a5a50b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:20 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-4d4442ad-e722-45fe-82f3-37619ae7d046 req-2114ee50-e9e3-4583-b2ee-686ba6a5a50b service nova] Creating event network-vif-plugged:67386c8f-911d-4398-b449-42af25f6afe3 for instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 on user Apr 17 10:54:20 user devstack@n-api.service[72745]: DEBUG nova.compute.api [req-4d4442ad-e722-45fe-82f3-37619ae7d046 req-2114ee50-e9e3-4583-b2ee-686ba6a5a50b service nova] Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 17 10:54:20 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-4d4442ad-e722-45fe-82f3-37619ae7d046 req-2114ee50-e9e3-4583-b2ee-686ba6a5a50b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209876 Apr 17 10:54:20 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 273/796] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:54:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:54:29 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:29 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=5 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:29 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-e4c5a7cc-10a0-4913-8c41-86c9b20b704c req-a6dc2497-5675-424e-b685-45840dd661c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38", "name": "network-vif-plugged", "status": "completed", "tag": "67386c8f-911d-4398-b449-42af25f6afe3"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:54:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-e4c5a7cc-10a0-4913-8c41-86c9b20b704c req-a6dc2497-5675-424e-b685-45840dd661c6 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-e4c5a7cc-10a0-4913-8c41-86c9b20b704c req-a6dc2497-5675-424e-b685-45840dd661c6 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-e4c5a7cc-10a0-4913-8c41-86c9b20b704c req-a6dc2497-5675-424e-b685-45840dd661c6 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:29 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-e4c5a7cc-10a0-4913-8c41-86c9b20b704c req-a6dc2497-5675-424e-b685-45840dd661c6 service nova] Creating event network-vif-plugged:67386c8f-911d-4398-b449-42af25f6afe3 for instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 on user Apr 17 10:54:29 user devstack@n-api.service[72743]: DEBUG nova.compute.api [req-e4c5a7cc-10a0-4913-8c41-86c9b20b704c req-a6dc2497-5675-424e-b685-45840dd661c6 service nova] Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72743) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 17 10:54:29 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-e4c5a7cc-10a0-4913-8c41-86c9b20b704c req-a6dc2497-5675-424e-b685-45840dd661c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047951 Apr 17 10:54:29 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 269/797] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:54:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 10:54:31 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:31 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=4 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:31 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-0a192f21-3dfb-4c4e-bb4b-8e16c9c73948 req-e6ea4e56-6769-4354-85e4-bb22004a6676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38", "name": "network-vif-plugged", "status": "completed", "tag": "67386c8f-911d-4398-b449-42af25f6afe3"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:54:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-0a192f21-3dfb-4c4e-bb4b-8e16c9c73948 req-e6ea4e56-6769-4354-85e4-bb22004a6676 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-0a192f21-3dfb-4c4e-bb4b-8e16c9c73948 req-e6ea4e56-6769-4354-85e4-bb22004a6676 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-0a192f21-3dfb-4c4e-bb4b-8e16c9c73948 req-e6ea4e56-6769-4354-85e4-bb22004a6676 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:31 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-0a192f21-3dfb-4c4e-bb4b-8e16c9c73948 req-e6ea4e56-6769-4354-85e4-bb22004a6676 service nova] Creating event network-vif-plugged:67386c8f-911d-4398-b449-42af25f6afe3 for instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 on user Apr 17 10:54:31 user devstack@n-api.service[72744]: DEBUG nova.compute.api [req-0a192f21-3dfb-4c4e-bb4b-8e16c9c73948 req-e6ea4e56-6769-4354-85e4-bb22004a6676 service nova] Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72744) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 17 10:54:31 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-0a192f21-3dfb-4c4e-bb4b-8e16c9c73948 req-e6ea4e56-6769-4354-85e4-bb22004a6676 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041693 Apr 17 10:54:31 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 256/798] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:54:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:54:34 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=3 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:34 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=15 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:34 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:34 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-40a50942-204d-4608-a3cf-1cbedab2cac4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:54:34 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-40a50942-204d-4608-a3cf-1cbedab2cac4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: 3fd89020-5492-4e40-a911-63f9b1b43315] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:54:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-40a50942-204d-4608-a3cf-1cbedab2cac4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-40a50942-204d-4608-a3cf-1cbedab2cac4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-40a50942-204d-4608-a3cf-1cbedab2cac4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-40a50942-204d-4608-a3cf-1cbedab2cac4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-40a50942-204d-4608-a3cf-1cbedab2cac4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-40a50942-204d-4608-a3cf-1cbedab2cac4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:34 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-40a50942-204d-4608-a3cf-1cbedab2cac4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] HTTP exception thrown: Instance 3fd89020-5492-4e40-a911-63f9b1b43315 could not be found. Apr 17 10:54:34 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-40a50942-204d-4608-a3cf-1cbedab2cac4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Request method failure captured: Apr 17 10:54:34 user devstack@n-api.service[72745]: request: GET /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315 HTTP/1.1 Apr 17 10:54:34 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:54:34 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:54:34 user devstack@n-api.service[72745]: Connection: close Apr 17 10:54:34 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 10:54:34 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:54:34 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:54:34 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:54:34 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:54:34 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSP-BtSOnsyB6KCaTxrrgInwl952BD18h9y51bwpAjWCA4Hbw1ASyPBLVrH2legVLq48N7IHlYA6cu4Ku2IXDLWK2ZiMfyI2VKOhTFw2CQ0qtXeShRjPK1bZ0whL7jFPD2oxtfVkX2pocE_tUozBhIsfCRD5HOWhpbvxnT2lby50mMU Apr 17 10:54:34 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:54:34 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:54:34 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:54:34 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:54:34 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:54:34 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:54:34 user devstack@n-api.service[72745]: X-Project-Id: 455ea6870abe450ba413ffabf4d4097e Apr 17 10:54:34 user devstack@n-api.service[72745]: X-Project-Name: tempest-TestMinimumBasicScenario-1309632250 Apr 17 10:54:34 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:54:34 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:54:34 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/455ea6870abe450ba413ffabf4d4097e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/455ea6870abe450ba413ffabf4d4097e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/455ea6870abe450ba413ffabf4d4097e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:54:34 user devstack@n-api.service[72745]: X-Tenant: tempest-TestMinimumBasicScenario-1309632250 Apr 17 10:54:34 user devstack@n-api.service[72745]: X-Tenant-Id: 455ea6870abe450ba413ffabf4d4097e Apr 17 10:54:34 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1309632250 Apr 17 10:54:34 user devstack@n-api.service[72745]: X-User: tempest-TestMinimumBasicScenario-1309632250-project-member Apr 17 10:54:34 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:54:34 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:54:34 user devstack@n-api.service[72745]: X-User-Id: df693038f49145b9854ae18d246dde2f Apr 17 10:54:34 user devstack@n-api.service[72745]: X-User-Name: tempest-TestMinimumBasicScenario-1309632250-project-member Apr 17 10:54:34 user devstack@n-api.service[72745]: method: > Apr 17 10:54:34 user devstack@n-api.service[72745]: exception: Instance 3fd89020-5492-4e40-a911-63f9b1b43315 could not be found. Apr 17 10:54:34 user devstack@n-api.service[72745]: action_args: {'id': '3fd89020-5492-4e40-a911-63f9b1b43315'} Apr 17 10:54:34 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fd89020-5492-4e40-a911-63f9b1b43315 could not be found. Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fd89020-5492-4e40-a911-63f9b1b43315 could not be found. Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fd89020-5492-4e40-a911-63f9b1b43315 could not be found. Apr 17 10:54:34 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:54:34 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-40a50942-204d-4608-a3cf-1cbedab2cac4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Returning 404 to user: Instance 3fd89020-5492-4e40-a911-63f9b1b43315 could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:54:34 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-40a50942-204d-4608-a3cf-1cbedab2cac4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315" status: 404 len: 111 microversion: 2.1 time: 0.039013 Apr 17 10:54:34 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 274/799] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:54:34 2023] GET /compute/v2.1/servers/3fd89020-5492-4e40-a911-63f9b1b43315 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:54:34 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-0882c01e-f470-4b37-977e-c2d1ab00a719 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '.version_select at 0x7fc55aa392d0>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:54:34 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-0882c01e-f470-4b37-977e-c2d1ab00a719 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-893387962" status: 202 len: 0 microversion: 2.1 time: 0.027641 Apr 17 10:54:34 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 270/800] 10.0.0.210 () {62 vars in 1346 bytes} [Mon Apr 17 10:54:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-893387962 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:54:37 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-eea4f47b-8076-4780-84ae-f4f87a9b98cc tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Action: 'create', calling method: .version_select at 0x7fc55a7cec20>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1990324644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2LcQKOJIbCueTFlVX50X2EGvDm6laToZFGZ7y29eU+7fJvpuVyKrKflWnfn7Z0uS0xG8jdApM7wiOOz9SiILReN8+PYwYvEof/j98ElqWxcbuwNLVD70dwsz0wd5YmQg=="}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:54:37 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-eea4f47b-8076-4780-84ae-f4f87a9b98cc tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Getting quotas for project 455ea6870abe450ba413ffabf4d4097e. Resources: {'key_pairs'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:54:37 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-eea4f47b-8076-4780-84ae-f4f87a9b98cc tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Getting quotas for user df693038f49145b9854ae18d246dde2f and project 455ea6870abe450ba413ffabf4d4097e. Resources: {'key_pairs'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:54:37 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-eea4f47b-8076-4780-84ae-f4f87a9b98cc tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.045733 Apr 17 10:54:37 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 257/801] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 10:54:37 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:54:37 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1044969384", "imageRef": "3dd99358-1e69-4b00-8c6f-b2c7b3320f3e", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1990324644", "networks": [{"uuid": "519dcb44-4125-4a92-9e76-0c22271f7ca8"}]}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:54:37 user devstack@n-api.service[72745]: DEBUG nova.network.neutron [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] validate_networks() for [('519dcb44-4125-4a92-9e76-0c22271f7ca8', None, None, None, None, None)] {{(pid=72745) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:54:38 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Flavor limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:54:38 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Image limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:54:38 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Flavor pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:54:38 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Image pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:54:38 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:54:38 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:38 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:38 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:38 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:38 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:38 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:38 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Getting quotas for project 455ea6870abe450ba413ffabf4d4097e. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:54:38 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Getting quotas for user df693038f49145b9854ae18d246dde2f and project 455ea6870abe450ba413ffabf4d4097e. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:54:38 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Going to run 1 instances... {{(pid=72745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:54:38 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd99358-1e69-4b00-8c6f-b2c7b3320f3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:54:38 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-96131653-7c2a-4de6-bd92-028b6ea10c60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.054564 Apr 17 10:54:38 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 275/802] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:54:37 2023] POST /compute/v2.1/servers => generated 378 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 10:54:38 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-e066d722-3495-462f-9f0a-90331a5b04ac tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:54:38 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-e066d722-3495-462f-9f0a-90331a5b04ac tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:54:38 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-e066d722-3495-462f-9f0a-90331a5b04ac tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df693038f49145b9854ae18d246dde2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455ea6870abe450ba413ffabf4d4097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:54:38 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-e066d722-3495-462f-9f0a-90331a5b04ac tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4" status: 200 len: 1253 microversion: 2.1 time: 0.110264 Apr 17 10:54:38 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 271/803] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:54:38 2023] GET /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4 => generated 1253 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:54:41 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-4765bf35-9a08-4353-b421-957d2bdfc4c4 req-22bfb5c4-391d-4112-a455-417e48919c21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb68ad13-6870-417f-8593-4d41724109f4", "tag": "e139dcf1-9c53-4c70-849f-1a8126e4d347"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:54:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-4765bf35-9a08-4353-b421-957d2bdfc4c4 req-22bfb5c4-391d-4112-a455-417e48919c21 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-4765bf35-9a08-4353-b421-957d2bdfc4c4 req-22bfb5c4-391d-4112-a455-417e48919c21 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-4765bf35-9a08-4353-b421-957d2bdfc4c4 req-22bfb5c4-391d-4112-a455-417e48919c21 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:41 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-4765bf35-9a08-4353-b421-957d2bdfc4c4 req-22bfb5c4-391d-4112-a455-417e48919c21 service nova] Creating event network-changed:e139dcf1-9c53-4c70-849f-1a8126e4d347 for instance bb68ad13-6870-417f-8593-4d41724109f4 on user Apr 17 10:54:41 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-4765bf35-9a08-4353-b421-957d2bdfc4c4 req-22bfb5c4-391d-4112-a455-417e48919c21 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033350 Apr 17 10:54:41 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 258/804] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:54:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:54:43 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-47339ff0-584a-47c0-9956-4616a478ce26 req-c8755b30-94a6-4413-a66a-6a78b39fb6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb68ad13-6870-417f-8593-4d41724109f4", "name": "network-vif-plugged", "status": "completed", "tag": "e139dcf1-9c53-4c70-849f-1a8126e4d347"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:54:43 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-61e5b6c1-cd92-44aa-9084-3f05d1f8e7b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:54:43 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-61e5b6c1-cd92-44aa-9084-3f05d1f8e7b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:54:43 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=4 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:43 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-47339ff0-584a-47c0-9956-4616a478ce26 req-c8755b30-94a6-4413-a66a-6a78b39fb6f3 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:43 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-47339ff0-584a-47c0-9956-4616a478ce26 req-c8755b30-94a6-4413-a66a-6a78b39fb6f3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:43 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-47339ff0-584a-47c0-9956-4616a478ce26 req-c8755b30-94a6-4413-a66a-6a78b39fb6f3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:43 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-61e5b6c1-cd92-44aa-9084-3f05d1f8e7b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:43 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-61e5b6c1-cd92-44aa-9084-3f05d1f8e7b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:43 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-61e5b6c1-cd92-44aa-9084-3f05d1f8e7b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:43 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-61e5b6c1-cd92-44aa-9084-3f05d1f8e7b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:43 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-61e5b6c1-cd92-44aa-9084-3f05d1f8e7b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:43 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-61e5b6c1-cd92-44aa-9084-3f05d1f8e7b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:43 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-47339ff0-584a-47c0-9956-4616a478ce26 req-c8755b30-94a6-4413-a66a-6a78b39fb6f3 service nova] Creating event network-vif-plugged:e139dcf1-9c53-4c70-849f-1a8126e4d347 for instance bb68ad13-6870-417f-8593-4d41724109f4 on user Apr 17 10:54:43 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-47339ff0-584a-47c0-9956-4616a478ce26 req-c8755b30-94a6-4413-a66a-6a78b39fb6f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037158 Apr 17 10:54:43 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 276/805] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:54:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:54:43 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-61e5b6c1-cd92-44aa-9084-3f05d1f8e7b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:54:43 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-61e5b6c1-cd92-44aa-9084-3f05d1f8e7b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/109ee5e0-8c02-43c2-9415-48bb0c8c3a06" status: 200 len: 1394 microversion: 2.1 time: 0.261009 Apr 17 10:54:43 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 272/806] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:54:43 2023] GET /compute/v2.1/servers/109ee5e0-8c02-43c2-9415-48bb0c8c3a06 => generated 1394 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:54:45 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-30b53c2f-f05e-4605-b60d-33a7aec8fa45 req-9c6a8c88-725b-4997-9170-921118a9b165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb68ad13-6870-417f-8593-4d41724109f4", "name": "network-vif-plugged", "status": "completed", "tag": "e139dcf1-9c53-4c70-849f-1a8126e4d347"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:54:45 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-30b53c2f-f05e-4605-b60d-33a7aec8fa45 req-9c6a8c88-725b-4997-9170-921118a9b165 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:45 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-30b53c2f-f05e-4605-b60d-33a7aec8fa45 req-9c6a8c88-725b-4997-9170-921118a9b165 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:45 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-30b53c2f-f05e-4605-b60d-33a7aec8fa45 req-9c6a8c88-725b-4997-9170-921118a9b165 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:45 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-30b53c2f-f05e-4605-b60d-33a7aec8fa45 req-9c6a8c88-725b-4997-9170-921118a9b165 service nova] Creating event network-vif-plugged:e139dcf1-9c53-4c70-849f-1a8126e4d347 for instance bb68ad13-6870-417f-8593-4d41724109f4 on user Apr 17 10:54:45 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-30b53c2f-f05e-4605-b60d-33a7aec8fa45 req-9c6a8c88-725b-4997-9170-921118a9b165 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030380 Apr 17 10:54:45 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 259/807] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:54:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:54:55 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:55 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:55 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:55 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:55 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-bbd0c7f8-eeb2-4305-b794-e54d227a5797 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:54:55 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-bbd0c7f8-eeb2-4305-b794-e54d227a5797 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:54:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-bbd0c7f8-eeb2-4305-b794-e54d227a5797 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-bbd0c7f8-eeb2-4305-b794-e54d227a5797 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-bbd0c7f8-eeb2-4305-b794-e54d227a5797 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-bbd0c7f8-eeb2-4305-b794-e54d227a5797 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-bbd0c7f8-eeb2-4305-b794-e54d227a5797 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-bbd0c7f8-eeb2-4305-b794-e54d227a5797 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:55 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-bbd0c7f8-eeb2-4305-b794-e54d227a5797 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] HTTP exception thrown: Instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab could not be found. Apr 17 10:54:55 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-bbd0c7f8-eeb2-4305-b794-e54d227a5797 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Request method failure captured: Apr 17 10:54:55 user devstack@n-api.service[72745]: request: GET /compute/v2.1/servers/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab HTTP/1.1 Apr 17 10:54:55 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:54:55 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:54:55 user devstack@n-api.service[72745]: Connection: close Apr 17 10:54:55 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 10:54:55 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:54:55 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:54:55 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:54:55 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:54:55 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSCx__KUye5c5Uk1RXfpSnCpy1lFvFSvuM0sqOq3yjGM_kIZ6rog0pzp377pLuUEu0MKOwWfAyxQsyqbyJTO9toZgftEDYYUD_kO00bm1Cv0DJ1s6ltCoIXj-DHCi0Gg2bhQ1w34NOyeyRqGGzjl0Y5w3hATzQKxADNewisDJmiiGoQ Apr 17 10:54:55 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:54:55 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:54:55 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:54:55 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:54:55 user devstack@n-api.service[72745]: X-Openstack-Nova-Api-Version: 2.87 Apr 17 10:54:55 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:54:55 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:54:55 user devstack@n-api.service[72745]: X-Project-Id: faab4afa0ddf45578232627c2fac2ff8 Apr 17 10:54:55 user devstack@n-api.service[72745]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-933538997 Apr 17 10:54:55 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:54:55 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:54:55 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/faab4afa0ddf45578232627c2fac2ff8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/faab4afa0ddf45578232627c2fac2ff8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/faab4afa0ddf45578232627c2fac2ff8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:54:55 user devstack@n-api.service[72745]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-933538997 Apr 17 10:54:55 user devstack@n-api.service[72745]: X-Tenant-Id: faab4afa0ddf45578232627c2fac2ff8 Apr 17 10:54:55 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-933538997 Apr 17 10:54:55 user devstack@n-api.service[72745]: X-User: tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member Apr 17 10:54:55 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:54:55 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:54:55 user devstack@n-api.service[72745]: X-User-Id: d8cb73d24d324903a625e4782270120e Apr 17 10:54:55 user devstack@n-api.service[72745]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member Apr 17 10:54:55 user devstack@n-api.service[72745]: method: > Apr 17 10:54:55 user devstack@n-api.service[72745]: exception: Instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab could not be found. Apr 17 10:54:55 user devstack@n-api.service[72745]: action_args: {'id': '1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab'} Apr 17 10:54:55 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab could not be found. Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab could not be found. Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab could not be found. Apr 17 10:54:55 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:54:55 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-bbd0c7f8-eeb2-4305-b794-e54d227a5797 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Returning 404 to user: Instance 1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:54:55 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-bbd0c7f8-eeb2-4305-b794-e54d227a5797 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab" status: 404 len: 111 microversion: 2.87 time: 0.039479 Apr 17 10:54:55 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 277/808] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:54:55 2023] GET /compute/v2.1/servers/1c7dc93c-3fec-4ba7-b20b-5dd2462cb2ab => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 10:54:55 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:54:55 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:54:55 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:55 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:55 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:55 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:55 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:55 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:55 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:55 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:55 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:55 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Going to try to terminate instance {{(pid=72743) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:54:55 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-40ec1d78-e99e-469a-bd86-14fbcedccb0d tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/60008675-7786-4a26-9640-49da6efd0adb" status: 204 len: 0 microversion: 2.87 time: 0.187089 Apr 17 10:54:55 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 273/809] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 17 10:54:55 2023] DELETE /compute/v2.1/servers/60008675-7786-4a26-9640-49da6efd0adb => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 17 10:54:55 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=4 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:55 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:55 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=8 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:54:55 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-21dc6265-8c2d-4a79-9e15-fc91a23cacc1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:54:55 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-21dc6265-8c2d-4a79-9e15-fc91a23cacc1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:54:55 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-21dc6265-8c2d-4a79-9e15-fc91a23cacc1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:55 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-21dc6265-8c2d-4a79-9e15-fc91a23cacc1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:55 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-21dc6265-8c2d-4a79-9e15-fc91a23cacc1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:55 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-21dc6265-8c2d-4a79-9e15-fc91a23cacc1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:55 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-21dc6265-8c2d-4a79-9e15-fc91a23cacc1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:55 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-21dc6265-8c2d-4a79-9e15-fc91a23cacc1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:56 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-21dc6265-8c2d-4a79-9e15-fc91a23cacc1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:54:56 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-21dc6265-8c2d-4a79-9e15-fc91a23cacc1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:54:56 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-21dc6265-8c2d-4a79-9e15-fc91a23cacc1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8cb73d24d324903a625e4782270120e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faab4afa0ddf45578232627c2fac2ff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:54:56 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-bae9fc89-9b4f-438b-9c45-b04832fda57b req-71380c84-d5e9-4649-8f0c-d97261a6a9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60008675-7786-4a26-9640-49da6efd0adb", "name": "network-vif-unplugged", "status": "completed", "tag": "d6e0e749-1043-40c1-8401-8aae219f3924"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:54:56 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-21dc6265-8c2d-4a79-9e15-fc91a23cacc1 tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/60008675-7786-4a26-9640-49da6efd0adb" status: 200 len: 1696 microversion: 2.87 time: 0.360887 Apr 17 10:54:56 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 260/810] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:54:55 2023] GET /compute/v2.1/servers/60008675-7786-4a26-9640-49da6efd0adb => generated 1696 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 10:54:56 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-bae9fc89-9b4f-438b-9c45-b04832fda57b req-71380c84-d5e9-4649-8f0c-d97261a6a9c2 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:56 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-bae9fc89-9b4f-438b-9c45-b04832fda57b req-71380c84-d5e9-4649-8f0c-d97261a6a9c2 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:56 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-bae9fc89-9b4f-438b-9c45-b04832fda57b req-71380c84-d5e9-4649-8f0c-d97261a6a9c2 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:56 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-bae9fc89-9b4f-438b-9c45-b04832fda57b req-71380c84-d5e9-4649-8f0c-d97261a6a9c2 service nova] Creating event network-vif-unplugged:d6e0e749-1043-40c1-8401-8aae219f3924 for instance 60008675-7786-4a26-9640-49da6efd0adb on user Apr 17 10:54:56 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-bae9fc89-9b4f-438b-9c45-b04832fda57b req-71380c84-d5e9-4649-8f0c-d97261a6a9c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027952 Apr 17 10:54:56 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 278/811] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:54:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:54:58 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-4787cd97-2a83-423f-ac75-f76ae1d681c3 req-5625aeac-d83c-4124-b59b-f431ea9404d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60008675-7786-4a26-9640-49da6efd0adb", "name": "network-vif-plugged", "status": "completed", "tag": "d6e0e749-1043-40c1-8401-8aae219f3924"}, {"server_uuid": "60008675-7786-4a26-9640-49da6efd0adb", "name": "network-vif-deleted", "tag": "d6e0e749-1043-40c1-8401-8aae219f3924"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:54:58 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-4787cd97-2a83-423f-ac75-f76ae1d681c3 req-5625aeac-d83c-4124-b59b-f431ea9404d2 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:58 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-4787cd97-2a83-423f-ac75-f76ae1d681c3 req-5625aeac-d83c-4124-b59b-f431ea9404d2 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:58 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-4787cd97-2a83-423f-ac75-f76ae1d681c3 req-5625aeac-d83c-4124-b59b-f431ea9404d2 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:58 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-4787cd97-2a83-423f-ac75-f76ae1d681c3 req-5625aeac-d83c-4124-b59b-f431ea9404d2 service nova] Creating event network-vif-plugged:d6e0e749-1043-40c1-8401-8aae219f3924 for instance 60008675-7786-4a26-9640-49da6efd0adb on user Apr 17 10:54:58 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-4787cd97-2a83-423f-ac75-f76ae1d681c3 req-5625aeac-d83c-4124-b59b-f431ea9404d2 service nova] Creating event network-vif-deleted:d6e0e749-1043-40c1-8401-8aae219f3924 for instance 60008675-7786-4a26-9640-49da6efd0adb on user Apr 17 10:54:58 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-4787cd97-2a83-423f-ac75-f76ae1d681c3 req-5625aeac-d83c-4124-b59b-f431ea9404d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030962 Apr 17 10:54:58 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 274/812] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:54:58 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:54:59 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9be4f595-6c61-424f-8df8-cdb6fa8383d2", "device": "/dev/vdb"}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:54:59 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:54:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:54:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:54:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:54:59 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-ecbb9c25-ea53-49a3-a48e-f9fb107c0a7d tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0deb56c2-1224-488f-9d30-4082ec677dc7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.356682 Apr 17 10:54:59 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 261/813] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Apr 17 10:54:59 2023] POST /compute/v2.1/servers/0deb56c2-1224-488f-9d30-4082ec677dc7/os-volume_attachments => generated 194 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:55:06 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-ff89e0fa-3ebc-46f8-aef2-3ede66e92e4a tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:55:06 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-ff89e0fa-3ebc-46f8-aef2-3ede66e92e4a tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:55:06 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=4 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:55:06 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=4 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:55:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ff89e0fa-3ebc-46f8-aef2-3ede66e92e4a tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:55:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ff89e0fa-3ebc-46f8-aef2-3ede66e92e4a tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:55:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ff89e0fa-3ebc-46f8-aef2-3ede66e92e4a tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:55:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ff89e0fa-3ebc-46f8-aef2-3ede66e92e4a tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:55:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ff89e0fa-3ebc-46f8-aef2-3ede66e92e4a tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:55:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ff89e0fa-3ebc-46f8-aef2-3ede66e92e4a tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:55:06 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-ff89e0fa-3ebc-46f8-aef2-3ede66e92e4a tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:55:06 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-ff89e0fa-3ebc-46f8-aef2-3ede66e92e4a tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 200 len: 1729 microversion: 2.1 time: 0.319454 Apr 17 10:55:06 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 279/814] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:55:06 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 1729 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:55:23 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:55:23 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:55:23 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:55:23 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:55:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:55:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:55:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:55:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:55:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:55:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:55:23 user devstack@n-api.service[72743]: DEBUG nova.objects.instance [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lazy-loading 'services' on Instance uuid 0deb56c2-1224-488f-9d30-4082ec677dc7 {{(pid=72743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 10:55:23 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-25dfe980-a710-459b-9d21-980141008239 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0deb56c2-1224-488f-9d30-4082ec677dc7/os-volume_attachments/9be4f595-6c61-424f-8df8-cdb6fa8383d2" status: 202 len: 0 microversion: 2.1 time: 0.272894 Apr 17 10:55:23 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 275/815] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Apr 17 10:55:23 2023] DELETE /compute/v2.1/servers/0deb56c2-1224-488f-9d30-4082ec677dc7/os-volume_attachments/9be4f595-6c61-424f-8df8-cdb6fa8383d2 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:55:23 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:55:23 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:55:23 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:55:23 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:55:23 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:55:23 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:55:23 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:55:23 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:55:23 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:55:23 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:55:23 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Going to try to terminate instance {{(pid=72744) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:55:23 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-2f12a957-3541-4736-9a38-b9580e9c15d5 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0deb56c2-1224-488f-9d30-4082ec677dc7" status: 204 len: 0 microversion: 2.1 time: 0.126947 Apr 17 10:55:23 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 262/816] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:55:23 2023] DELETE /compute/v2.1/servers/0deb56c2-1224-488f-9d30-4082ec677dc7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:55:23 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-d9ed2cfe-3268-4efd-8e81-d719cdf5baf6 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:55:23 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-d9ed2cfe-3268-4efd-8e81-d719cdf5baf6 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:55:23 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:55:23 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:55:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d9ed2cfe-3268-4efd-8e81-d719cdf5baf6 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:55:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d9ed2cfe-3268-4efd-8e81-d719cdf5baf6 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:55:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d9ed2cfe-3268-4efd-8e81-d719cdf5baf6 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:55:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d9ed2cfe-3268-4efd-8e81-d719cdf5baf6 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:55:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d9ed2cfe-3268-4efd-8e81-d719cdf5baf6 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:55:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d9ed2cfe-3268-4efd-8e81-d719cdf5baf6 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:55:24 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-d9ed2cfe-3268-4efd-8e81-d719cdf5baf6 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad2b6b478547e78e2cf273ef0390ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652f9a7f20954e23b143e349c538f418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:55:24 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-d9ed2cfe-3268-4efd-8e81-d719cdf5baf6 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0deb56c2-1224-488f-9d30-4082ec677dc7" status: 200 len: 1549 microversion: 2.1 time: 0.249459 Apr 17 10:55:24 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 280/817] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:55:23 2023] GET /compute/v2.1/servers/0deb56c2-1224-488f-9d30-4082ec677dc7 => generated 1549 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:55:25 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-e39cead4-67bc-405f-a593-be190526f121 req-d9e93698-60b6-4c4b-8ab8-68f32e55bf06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0deb56c2-1224-488f-9d30-4082ec677dc7", "name": "network-vif-unplugged", "status": "completed", "tag": "0464e1cc-c5eb-4e76-be88-393898a80f3b"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:55:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-e39cead4-67bc-405f-a593-be190526f121 req-d9e93698-60b6-4c4b-8ab8-68f32e55bf06 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:55:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-e39cead4-67bc-405f-a593-be190526f121 req-d9e93698-60b6-4c4b-8ab8-68f32e55bf06 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:55:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-e39cead4-67bc-405f-a593-be190526f121 req-d9e93698-60b6-4c4b-8ab8-68f32e55bf06 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:55:25 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-e39cead4-67bc-405f-a593-be190526f121 req-d9e93698-60b6-4c4b-8ab8-68f32e55bf06 service nova] Creating event network-vif-unplugged:0464e1cc-c5eb-4e76-be88-393898a80f3b for instance 0deb56c2-1224-488f-9d30-4082ec677dc7 on user Apr 17 10:55:25 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-e39cead4-67bc-405f-a593-be190526f121 req-d9e93698-60b6-4c4b-8ab8-68f32e55bf06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037333 Apr 17 10:55:25 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 276/818] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:55:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:55:26 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-cef2e8f4-d6fa-4028-9812-15fb5ac2a468 req-f8bd496e-b001-49a1-a993-bed50bb13e91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0deb56c2-1224-488f-9d30-4082ec677dc7", "name": "network-vif-deleted", "tag": "0464e1cc-c5eb-4e76-be88-393898a80f3b"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:55:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-cef2e8f4-d6fa-4028-9812-15fb5ac2a468 req-f8bd496e-b001-49a1-a993-bed50bb13e91 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:55:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-cef2e8f4-d6fa-4028-9812-15fb5ac2a468 req-f8bd496e-b001-49a1-a993-bed50bb13e91 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:55:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-cef2e8f4-d6fa-4028-9812-15fb5ac2a468 req-f8bd496e-b001-49a1-a993-bed50bb13e91 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:55:26 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-cef2e8f4-d6fa-4028-9812-15fb5ac2a468 req-f8bd496e-b001-49a1-a993-bed50bb13e91 service nova] Creating event network-vif-deleted:0464e1cc-c5eb-4e76-be88-393898a80f3b for instance 0deb56c2-1224-488f-9d30-4082ec677dc7 on user Apr 17 10:55:26 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-cef2e8f4-d6fa-4028-9812-15fb5ac2a468 req-f8bd496e-b001-49a1-a993-bed50bb13e91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032262 Apr 17 10:55:26 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 263/819] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:55:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:55:27 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-6e930698-67fd-48df-ae59-02a73d75c7c0 req-5afdf239-9d48-4b20-b5e3-501c634a9651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0deb56c2-1224-488f-9d30-4082ec677dc7", "name": "network-vif-plugged", "status": "completed", "tag": "0464e1cc-c5eb-4e76-be88-393898a80f3b"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:55:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-6e930698-67fd-48df-ae59-02a73d75c7c0 req-5afdf239-9d48-4b20-b5e3-501c634a9651 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:55:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-6e930698-67fd-48df-ae59-02a73d75c7c0 req-5afdf239-9d48-4b20-b5e3-501c634a9651 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:55:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-6e930698-67fd-48df-ae59-02a73d75c7c0 req-5afdf239-9d48-4b20-b5e3-501c634a9651 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:55:27 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-6e930698-67fd-48df-ae59-02a73d75c7c0 req-5afdf239-9d48-4b20-b5e3-501c634a9651 service nova] Creating event network-vif-plugged:0464e1cc-c5eb-4e76-be88-393898a80f3b for instance 0deb56c2-1224-488f-9d30-4082ec677dc7 on user Apr 17 10:55:27 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-6e930698-67fd-48df-ae59-02a73d75c7c0 req-5afdf239-9d48-4b20-b5e3-501c634a9651 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033038 Apr 17 10:55:27 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 281/820] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:55:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:55:28 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-d2e647ab-6711-4564-b986-5c52eab7a9d4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:55:28 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-d2e647ab-6711-4564-b986-5c52eab7a9d4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:55:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d2e647ab-6711-4564-b986-5c52eab7a9d4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:55:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d2e647ab-6711-4564-b986-5c52eab7a9d4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:55:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d2e647ab-6711-4564-b986-5c52eab7a9d4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:55:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d2e647ab-6711-4564-b986-5c52eab7a9d4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:55:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d2e647ab-6711-4564-b986-5c52eab7a9d4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:55:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d2e647ab-6711-4564-b986-5c52eab7a9d4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:55:28 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-d2e647ab-6711-4564-b986-5c52eab7a9d4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df693038f49145b9854ae18d246dde2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455ea6870abe450ba413ffabf4d4097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:55:28 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-d2e647ab-6711-4564-b986-5c52eab7a9d4 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4" status: 200 len: 1536 microversion: 2.1 time: 0.250316 Apr 17 10:55:28 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 277/821] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:55:28 2023] GET /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4 => generated 1536 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:55:43 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:55:43 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:55:43 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-ac10078a-faa4-4497-998b-08a7dd634e30 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:55:43 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-ac10078a-faa4-4497-998b-08a7dd634e30 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:55:43 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ac10078a-faa4-4497-998b-08a7dd634e30 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:55:43 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ac10078a-faa4-4497-998b-08a7dd634e30 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:55:43 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ac10078a-faa4-4497-998b-08a7dd634e30 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:55:43 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ac10078a-faa4-4497-998b-08a7dd634e30 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:55:43 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ac10078a-faa4-4497-998b-08a7dd634e30 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:55:43 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ac10078a-faa4-4497-998b-08a7dd634e30 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:55:43 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-ac10078a-faa4-4497-998b-08a7dd634e30 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:55:43 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-ac10078a-faa4-4497-998b-08a7dd634e30 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/109ee5e0-8c02-43c2-9415-48bb0c8c3a06" status: 200 len: 1394 microversion: 2.1 time: 0.296483 Apr 17 10:55:43 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 264/822] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:55:43 2023] GET /compute/v2.1/servers/109ee5e0-8c02-43c2-9415-48bb0c8c3a06 => generated 1394 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:55:43 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=4 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:55:43 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=8 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:55:43 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-8baff910-dd5e-4b7b-a57e-cb84ac76eb41 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-614101046"}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:55:43 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-8baff910-dd5e-4b7b-a57e-cb84ac76eb41 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:55:43 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8baff910-dd5e-4b7b-a57e-cb84ac76eb41 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:55:43 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8baff910-dd5e-4b7b-a57e-cb84ac76eb41 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:55:43 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8baff910-dd5e-4b7b-a57e-cb84ac76eb41 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:55:43 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8baff910-dd5e-4b7b-a57e-cb84ac76eb41 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:55:43 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8baff910-dd5e-4b7b-a57e-cb84ac76eb41 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:55:43 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8baff910-dd5e-4b7b-a57e-cb84ac76eb41 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:55:44 user devstack@n-api.service[72745]: INFO nova.compute.api [None req-8baff910-dd5e-4b7b-a57e-cb84ac76eb41 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Attempting to quiesce instance before volume snapshot. Apr 17 10:55:44 user devstack@n-api.service[72745]: INFO nova.compute.api [None req-8baff910-dd5e-4b7b-a57e-cb84ac76eb41 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 17 10:55:44 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-8baff910-dd5e-4b7b-a57e-cb84ac76eb41 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Creating snapshot from volume f9878792-e314-42e2-8384-f3175679bfb9. {{(pid=72745) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 17 10:55:46 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b0478757-93de-4ca2-9275-84bc4eab01eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:55:46 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-b0478757-93de-4ca2-9275-84bc4eab01eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] [instance: 60008675-7786-4a26-9640-49da6efd0adb] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:55:46 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:55:46 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:55:46 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b0478757-93de-4ca2-9275-84bc4eab01eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:55:46 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b0478757-93de-4ca2-9275-84bc4eab01eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:55:46 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b0478757-93de-4ca2-9275-84bc4eab01eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:55:46 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b0478757-93de-4ca2-9275-84bc4eab01eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:55:46 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b0478757-93de-4ca2-9275-84bc4eab01eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:55:46 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b0478757-93de-4ca2-9275-84bc4eab01eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:55:46 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-8baff910-dd5e-4b7b-a57e-cb84ac76eb41 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "POST /compute/v2.1/servers/109ee5e0-8c02-43c2-9415-48bb0c8c3a06/action" status: 202 len: 0 microversion: 2.1 time: 2.627662 Apr 17 10:55:46 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 282/823] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 10:55:43 2023] POST /compute/v2.1/servers/109ee5e0-8c02-43c2-9415-48bb0c8c3a06/action => generated 0 bytes in 2629 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 17 10:55:46 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-b0478757-93de-4ca2-9275-84bc4eab01eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] HTTP exception thrown: Instance 60008675-7786-4a26-9640-49da6efd0adb could not be found. Apr 17 10:55:46 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b0478757-93de-4ca2-9275-84bc4eab01eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Request method failure captured: Apr 17 10:55:46 user devstack@n-api.service[72743]: request: GET /compute/v2.1/servers/60008675-7786-4a26-9640-49da6efd0adb HTTP/1.1 Apr 17 10:55:46 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:55:46 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:55:46 user devstack@n-api.service[72743]: Connection: close Apr 17 10:55:46 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:55:46 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:55:46 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:55:46 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:55:46 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:55:46 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSCx__KUye5c5Uk1RXfpSnCpy1lFvFSvuM0sqOq3yjGM_kIZ6rog0pzp377pLuUEu0MKOwWfAyxQsyqbyJTO9toZgftEDYYUD_kO00bm1Cv0DJ1s6ltCoIXj-DHCi0Gg2bhQ1w34NOyeyRqGGzjl0Y5w3hATzQKxADNewisDJmiiGoQ Apr 17 10:55:46 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:55:46 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:55:46 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:55:46 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:55:46 user devstack@n-api.service[72743]: X-Openstack-Nova-Api-Version: 2.87 Apr 17 10:55:46 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:55:46 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:55:46 user devstack@n-api.service[72743]: X-Project-Id: faab4afa0ddf45578232627c2fac2ff8 Apr 17 10:55:46 user devstack@n-api.service[72743]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-933538997 Apr 17 10:55:46 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:55:46 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:55:46 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/faab4afa0ddf45578232627c2fac2ff8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/faab4afa0ddf45578232627c2fac2ff8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/faab4afa0ddf45578232627c2fac2ff8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:55:46 user devstack@n-api.service[72743]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-933538997 Apr 17 10:55:46 user devstack@n-api.service[72743]: X-Tenant-Id: faab4afa0ddf45578232627c2fac2ff8 Apr 17 10:55:46 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-933538997 Apr 17 10:55:46 user devstack@n-api.service[72743]: X-User: tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member Apr 17 10:55:46 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:55:46 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:55:46 user devstack@n-api.service[72743]: X-User-Id: d8cb73d24d324903a625e4782270120e Apr 17 10:55:46 user devstack@n-api.service[72743]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member Apr 17 10:55:46 user devstack@n-api.service[72743]: method: > Apr 17 10:55:46 user devstack@n-api.service[72743]: exception: Instance 60008675-7786-4a26-9640-49da6efd0adb could not be found. Apr 17 10:55:46 user devstack@n-api.service[72743]: action_args: {'id': '60008675-7786-4a26-9640-49da6efd0adb'} Apr 17 10:55:46 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60008675-7786-4a26-9640-49da6efd0adb could not be found. Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60008675-7786-4a26-9640-49da6efd0adb could not be found. Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60008675-7786-4a26-9640-49da6efd0adb could not be found. Apr 17 10:55:46 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:55:46 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b0478757-93de-4ca2-9275-84bc4eab01eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] Returning 404 to user: Instance 60008675-7786-4a26-9640-49da6efd0adb could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:55:46 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-b0478757-93de-4ca2-9275-84bc4eab01eb tempest-ServerBootFromVolumeStableRescueTest-933538997 tempest-ServerBootFromVolumeStableRescueTest-933538997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/60008675-7786-4a26-9640-49da6efd0adb" status: 404 len: 111 microversion: 2.87 time: 0.436533 Apr 17 10:55:46 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 278/824] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 10:55:46 2023] GET /compute/v2.1/servers/60008675-7786-4a26-9640-49da6efd0adb => generated 111 bytes in 438 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 10:55:47 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1228801841", "imageRef": "b05ec620-79c7-4f27-9579-bd293b9a2783", "flavorRef": "42", "networks": [{"uuid": "b2fc1cd4-860e-4abd-8e33-e797799c466f"}]}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:55:47 user devstack@n-api.service[72744]: DEBUG nova.network.neutron [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] validate_networks() for [('b2fc1cd4-860e-4abd-8e33-e797799c466f', None, None, None, None, None)] {{(pid=72744) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:55:49 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flavor limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:55:49 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Image limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:55:49 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flavor pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:55:49 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Image pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:55:49 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:55:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:55:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:55:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:55:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:55:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:55:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:55:49 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Getting quotas for project 4fc3b8e3925847d48b522206a8875d3f. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:55:49 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Getting quotas for user 0e4ed1192974484bba2d4392f4d011c2 and project 4fc3b8e3925847d48b522206a8875d3f. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:55:49 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Going to run 1 instances... {{(pid=72744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:55:49 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='8e89f1cf-8496-4d63-b6a5-f70ee50ec102',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=72744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:55:49 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-f14a1ed5-8670-4eb8-8935-2257cb4aa374 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.689044 Apr 17 10:55:49 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 265/825] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:55:47 2023] POST /compute/v2.1/servers => generated 378 bytes in 1690 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 17 10:55:49 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-ce182619-93b5-4487-9167-c0071a44241a tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:55:49 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-ce182619-93b5-4487-9167-c0071a44241a tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:55:49 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-ce182619-93b5-4487-9167-c0071a44241a tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:55:49 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-ce182619-93b5-4487-9167-c0071a44241a tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c0be0db8-2b49-43f1-8f6f-0f3c2d73e647" status: 200 len: 1224 microversion: 2.1 time: 0.110337 Apr 17 10:55:49 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 283/826] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:55:49 2023] GET /compute/v2.1/servers/c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 => generated 1224 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:55:52 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-74320034-ab68-4b5e-a75e-4729852c61f3 req-5f2282c5-8768-48e9-9a0e-d0b9630ae889 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0be0db8-2b49-43f1-8f6f-0f3c2d73e647", "tag": "ff468c15-f042-4b7c-8f06-903bb2b72b09"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:55:52 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-74320034-ab68-4b5e-a75e-4729852c61f3 req-5f2282c5-8768-48e9-9a0e-d0b9630ae889 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:55:52 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-74320034-ab68-4b5e-a75e-4729852c61f3 req-5f2282c5-8768-48e9-9a0e-d0b9630ae889 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:55:52 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-74320034-ab68-4b5e-a75e-4729852c61f3 req-5f2282c5-8768-48e9-9a0e-d0b9630ae889 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:55:52 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-74320034-ab68-4b5e-a75e-4729852c61f3 req-5f2282c5-8768-48e9-9a0e-d0b9630ae889 service nova] Creating event network-changed:ff468c15-f042-4b7c-8f06-903bb2b72b09 for instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 on user Apr 17 10:55:52 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-74320034-ab68-4b5e-a75e-4729852c61f3 req-5f2282c5-8768-48e9-9a0e-d0b9630ae889 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155601 Apr 17 10:55:52 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 279/827] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:55:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:55:58 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1021874936", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:55:58 user devstack@n-api.service[72744]: DEBUG nova.network.neutron [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] validate_networks() for [('f7747405-4e8a-4372-b07e-5ebf2852fe5f', None, None, None, None, None)] {{(pid=72744) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:55:59 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:55:59 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=8 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:55:59 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:55:59 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Flavor limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:55:59 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Image limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:55:59 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Flavor pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:55:59 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Image pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:55:59 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:55:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:55:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:55:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:55:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:55:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:55:59 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:55:59 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Getting quotas for project 3747b7d3c6844772b0e6eed5299053ba. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:55:59 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Getting quotas for user 30c15ce534a649ae8a971b33221e2500 and project 3747b7d3c6844772b0e6eed5299053ba. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:55:59 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Going to run 1 instances... {{(pid=72744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:55:59 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:55:59 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-ea750582-1e87-4dd4-9177-6cabc86c1c83 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.892681 Apr 17 10:55:59 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 266/828] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:55:58 2023] POST /compute/v2.1/servers => generated 381 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 10:55:59 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-39ab24c7-b3b3-48ca-a14a-f1b4105cd76c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:55:59 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-39ab24c7-b3b3-48ca-a14a-f1b4105cd76c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:55:59 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=14,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:55:59 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-39ab24c7-b3b3-48ca-a14a-f1b4105cd76c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c15ce534a649ae8a971b33221e2500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747b7d3c6844772b0e6eed5299053ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:55:59 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-39ab24c7-b3b3-48ca-a14a-f1b4105cd76c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" status: 200 len: 1216 microversion: 2.1 time: 0.077448 Apr 17 10:55:59 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 284/829] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:55:59 2023] GET /compute/v2.1/servers/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f => generated 1216 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:55:59 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1439667505", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:55:59 user devstack@n-api.service[72743]: DEBUG nova.network.neutron [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] validate_networks() for [('f7747405-4e8a-4372-b07e-5ebf2852fe5f', None, None, None, None, None)] {{(pid=72743) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:56:00 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Flavor limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:56:00 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Image limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:56:00 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Flavor pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:56:00 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Image pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:56:00 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:56:00 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:00 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:00 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:00 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:00 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:00 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:00 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Getting quotas for project 3747b7d3c6844772b0e6eed5299053ba. Resources: {'cores', 'instances', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:56:00 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Getting quotas for user 30c15ce534a649ae8a971b33221e2500 and project 3747b7d3c6844772b0e6eed5299053ba. Resources: {'cores', 'instances', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:56:00 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Going to run 1 instances... {{(pid=72743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:56:00 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:56:00 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-b909ffde-d613-4e5c-b9a6-bbe26f34e5f4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.520522 Apr 17 10:56:00 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 280/830] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:55:59 2023] POST /compute/v2.1/servers => generated 381 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 10:56:00 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-63c9dea7-fc14-4d10-918a-f393c7400155 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:56:00 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-63c9dea7-fc14-4d10-918a-f393c7400155 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:56:00 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-63c9dea7-fc14-4d10-918a-f393c7400155 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c15ce534a649ae8a971b33221e2500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747b7d3c6844772b0e6eed5299053ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:56:00 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-63c9dea7-fc14-4d10-918a-f393c7400155 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/385a180f-e722-4826-a6e0-47608461e66e" status: 200 len: 1216 microversion: 2.1 time: 0.067072 Apr 17 10:56:00 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 267/831] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:56:00 2023] GET /compute/v2.1/servers/385a180f-e722-4826-a6e0-47608461e66e => generated 1216 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:56:02 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-c5d56127-53fb-4f89-8c56-747b47b1ef86 req-d4f8193c-66a6-4d03-86f2-c919509eb87c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f", "tag": "9c6c71a5-0190-4112-9044-5c238344dc88"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:56:02 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-c5d56127-53fb-4f89-8c56-747b47b1ef86 req-d4f8193c-66a6-4d03-86f2-c919509eb87c service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:02 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-c5d56127-53fb-4f89-8c56-747b47b1ef86 req-d4f8193c-66a6-4d03-86f2-c919509eb87c service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:02 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-c5d56127-53fb-4f89-8c56-747b47b1ef86 req-d4f8193c-66a6-4d03-86f2-c919509eb87c service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:02 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-c5d56127-53fb-4f89-8c56-747b47b1ef86 req-d4f8193c-66a6-4d03-86f2-c919509eb87c service nova] Creating event network-changed:9c6c71a5-0190-4112-9044-5c238344dc88 for instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f on user Apr 17 10:56:02 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-c5d56127-53fb-4f89-8c56-747b47b1ef86 req-d4f8193c-66a6-4d03-86f2-c919509eb87c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033906 Apr 17 10:56:02 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 285/832] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:56:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:56:04 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-4fd239e5-88c1-4eba-8c80-5285d33db81f req-8aac1444-f0ef-49c2-bcb5-d579acc00900 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "385a180f-e722-4826-a6e0-47608461e66e", "tag": "8fca060e-eb45-4132-9515-99574c15e1a0"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:56:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-4fd239e5-88c1-4eba-8c80-5285d33db81f req-8aac1444-f0ef-49c2-bcb5-d579acc00900 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-4fd239e5-88c1-4eba-8c80-5285d33db81f req-8aac1444-f0ef-49c2-bcb5-d579acc00900 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-4fd239e5-88c1-4eba-8c80-5285d33db81f req-8aac1444-f0ef-49c2-bcb5-d579acc00900 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:04 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-4fd239e5-88c1-4eba-8c80-5285d33db81f req-8aac1444-f0ef-49c2-bcb5-d579acc00900 service nova] Creating event network-changed:8fca060e-eb45-4132-9515-99574c15e1a0 for instance 385a180f-e722-4826-a6e0-47608461e66e on user Apr 17 10:56:04 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-4fd239e5-88c1-4eba-8c80-5285d33db81f req-8aac1444-f0ef-49c2-bcb5-d579acc00900 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030582 Apr 17 10:56:04 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 281/833] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:56:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:56:05 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-cfaba6db-77e9-4478-9dbd-af1b832fffa3 req-5032a075-7bde-4fbc-a68f-4ca7fe0b5cdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0be0db8-2b49-43f1-8f6f-0f3c2d73e647", "name": "network-vif-plugged", "status": "completed", "tag": "ff468c15-f042-4b7c-8f06-903bb2b72b09"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:56:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-cfaba6db-77e9-4478-9dbd-af1b832fffa3 req-5032a075-7bde-4fbc-a68f-4ca7fe0b5cdb service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-cfaba6db-77e9-4478-9dbd-af1b832fffa3 req-5032a075-7bde-4fbc-a68f-4ca7fe0b5cdb service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-cfaba6db-77e9-4478-9dbd-af1b832fffa3 req-5032a075-7bde-4fbc-a68f-4ca7fe0b5cdb service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:05 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-cfaba6db-77e9-4478-9dbd-af1b832fffa3 req-5032a075-7bde-4fbc-a68f-4ca7fe0b5cdb service nova] Creating event network-vif-plugged:ff468c15-f042-4b7c-8f06-903bb2b72b09 for instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 on user Apr 17 10:56:05 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-cfaba6db-77e9-4478-9dbd-af1b832fffa3 req-5032a075-7bde-4fbc-a68f-4ca7fe0b5cdb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035428 Apr 17 10:56:05 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 268/834] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:56:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:56:06 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:56:06 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:56:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:06 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-03db1178-7d7a-47e4-833b-ca0bf3e9978d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/action" status: 202 len: 0 microversion: 2.1 time: 0.170501 Apr 17 10:56:06 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 286/835] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 10:56:06 2023] POST /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:56:06 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-7df2003d-418c-4046-8f55-e1c97caed3ba tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:56:06 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-7df2003d-418c-4046-8f55-e1c97caed3ba tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:56:06 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7df2003d-418c-4046-8f55-e1c97caed3ba tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:06 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7df2003d-418c-4046-8f55-e1c97caed3ba tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:06 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7df2003d-418c-4046-8f55-e1c97caed3ba tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:06 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7df2003d-418c-4046-8f55-e1c97caed3ba tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:06 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7df2003d-418c-4046-8f55-e1c97caed3ba tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:06 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7df2003d-418c-4046-8f55-e1c97caed3ba tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:07 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-7df2003d-418c-4046-8f55-e1c97caed3ba tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:56:07 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-7df2003d-418c-4046-8f55-e1c97caed3ba tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 200 len: 1728 microversion: 2.1 time: 0.323545 Apr 17 10:56:07 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 282/836] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:56:06 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 1728 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:56:07 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0be0db8-2b49-43f1-8f6f-0f3c2d73e647", "name": "network-vif-plugged", "status": "completed", "tag": "ff468c15-f042-4b7c-8f06-903bb2b72b09"}, {"server_uuid": "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f", "name": "network-vif-plugged", "status": "completed", "tag": "9c6c71a5-0190-4112-9044-5c238344dc88"}, {"server_uuid": "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f", "name": "network-vif-plugged", "status": "completed", "tag": "9c6c71a5-0190-4112-9044-5c238344dc88"}, {"server_uuid": "385a180f-e722-4826-a6e0-47608461e66e", "name": "network-vif-plugged", "status": "completed", "tag": "8fca060e-eb45-4132-9515-99574c15e1a0"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:56:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:07 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] Creating event network-vif-plugged:ff468c15-f042-4b7c-8f06-903bb2b72b09 for instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 on user Apr 17 10:56:07 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] Creating event network-vif-plugged:9c6c71a5-0190-4112-9044-5c238344dc88 for instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f on user Apr 17 10:56:07 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] Creating event network-vif-plugged:9c6c71a5-0190-4112-9044-5c238344dc88 for instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f on user Apr 17 10:56:07 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] Creating event network-vif-plugged:8fca060e-eb45-4132-9515-99574c15e1a0 for instance 385a180f-e722-4826-a6e0-47608461e66e on user Apr 17 10:56:07 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-da084151-7763-4d7a-b68b-e54b8e948f1f req-04b4fd48-a259-4464-808f-9835d97cca6a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.046525 Apr 17 10:56:07 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 269/837] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:56:07 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:56:08 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-3daca246-9178-4922-9f16-476da6998586 req-04729c59-1346-4d6b-8575-0af5a8bede40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38", "name": "network-vif-unplugged", "status": "completed", "tag": "67386c8f-911d-4398-b449-42af25f6afe3"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:56:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-3daca246-9178-4922-9f16-476da6998586 req-04729c59-1346-4d6b-8575-0af5a8bede40 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-3daca246-9178-4922-9f16-476da6998586 req-04729c59-1346-4d6b-8575-0af5a8bede40 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-3daca246-9178-4922-9f16-476da6998586 req-04729c59-1346-4d6b-8575-0af5a8bede40 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:08 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-3daca246-9178-4922-9f16-476da6998586 req-04729c59-1346-4d6b-8575-0af5a8bede40 service nova] Creating event network-vif-unplugged:67386c8f-911d-4398-b449-42af25f6afe3 for instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 on user Apr 17 10:56:08 user devstack@n-api.service[72745]: DEBUG nova.compute.api [req-3daca246-9178-4922-9f16-476da6998586 req-04729c59-1346-4d6b-8575-0af5a8bede40 service nova] Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 17 10:56:08 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-3daca246-9178-4922-9f16-476da6998586 req-04729c59-1346-4d6b-8575-0af5a8bede40 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051658 Apr 17 10:56:08 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 287/838] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:56:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:56:09 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-9352427b-169c-41b8-8318-21b7b03b7c7f req-a427ec86-fbbb-4e18-a3d1-9bce035d41ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "385a180f-e722-4826-a6e0-47608461e66e", "name": "network-vif-plugged", "status": "completed", "tag": "8fca060e-eb45-4132-9515-99574c15e1a0"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:56:09 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-9352427b-169c-41b8-8318-21b7b03b7c7f req-a427ec86-fbbb-4e18-a3d1-9bce035d41ea service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:09 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-9352427b-169c-41b8-8318-21b7b03b7c7f req-a427ec86-fbbb-4e18-a3d1-9bce035d41ea service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:09 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-9352427b-169c-41b8-8318-21b7b03b7c7f req-a427ec86-fbbb-4e18-a3d1-9bce035d41ea service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:09 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-9352427b-169c-41b8-8318-21b7b03b7c7f req-a427ec86-fbbb-4e18-a3d1-9bce035d41ea service nova] Creating event network-vif-plugged:8fca060e-eb45-4132-9515-99574c15e1a0 for instance 385a180f-e722-4826-a6e0-47608461e66e on user Apr 17 10:56:09 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-9352427b-169c-41b8-8318-21b7b03b7c7f req-a427ec86-fbbb-4e18-a3d1-9bce035d41ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066219 Apr 17 10:56:09 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 283/839] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:56:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:56:10 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:56:10 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-1f237d4f-afeb-4bfa-a770-a11a6e053115 req-e4e0ffe4-af60-45c7-9779-df0ad338e1c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38", "name": "network-vif-plugged", "status": "completed", "tag": "67386c8f-911d-4398-b449-42af25f6afe3"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:56:10 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-1f237d4f-afeb-4bfa-a770-a11a6e053115 req-e4e0ffe4-af60-45c7-9779-df0ad338e1c7 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:10 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-1f237d4f-afeb-4bfa-a770-a11a6e053115 req-e4e0ffe4-af60-45c7-9779-df0ad338e1c7 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:10 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-1f237d4f-afeb-4bfa-a770-a11a6e053115 req-e4e0ffe4-af60-45c7-9779-df0ad338e1c7 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:10 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=8 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:56:10 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-1f237d4f-afeb-4bfa-a770-a11a6e053115 req-e4e0ffe4-af60-45c7-9779-df0ad338e1c7 service nova] Creating event network-vif-plugged:67386c8f-911d-4398-b449-42af25f6afe3 for instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 on user Apr 17 10:56:10 user devstack@n-api.service[72744]: DEBUG nova.compute.api [req-1f237d4f-afeb-4bfa-a770-a11a6e053115 req-e4e0ffe4-af60-45c7-9779-df0ad338e1c7 service nova] Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72744) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 17 10:56:10 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-1f237d4f-afeb-4bfa-a770-a11a6e053115 req-e4e0ffe4-af60-45c7-9779-df0ad338e1c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069558 Apr 17 10:56:10 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 270/840] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:56:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:56:14 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=4 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:56:14 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-8a3c0459-1add-4c2b-90d6-fa0229c3db03 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:56:14 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-8a3c0459-1add-4c2b-90d6-fa0229c3db03 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] [instance: 0deb56c2-1224-488f-9d30-4082ec677dc7] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:56:14 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:56:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8a3c0459-1add-4c2b-90d6-fa0229c3db03 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8a3c0459-1add-4c2b-90d6-fa0229c3db03 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8a3c0459-1add-4c2b-90d6-fa0229c3db03 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8a3c0459-1add-4c2b-90d6-fa0229c3db03 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8a3c0459-1add-4c2b-90d6-fa0229c3db03 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-8a3c0459-1add-4c2b-90d6-fa0229c3db03 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:14 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-8a3c0459-1add-4c2b-90d6-fa0229c3db03 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] HTTP exception thrown: Instance 0deb56c2-1224-488f-9d30-4082ec677dc7 could not be found. Apr 17 10:56:14 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-8a3c0459-1add-4c2b-90d6-fa0229c3db03 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Request method failure captured: Apr 17 10:56:14 user devstack@n-api.service[72745]: request: GET /compute/v2.1/servers/0deb56c2-1224-488f-9d30-4082ec677dc7 HTTP/1.1 Apr 17 10:56:14 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:56:14 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:56:14 user devstack@n-api.service[72745]: Connection: close Apr 17 10:56:14 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 10:56:14 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:56:14 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:56:14 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:56:14 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:56:14 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSRCGBQUFOVVFYw4pUl-LTu4JKqlZev9Hwk5z4msYCeDd-DjSTg-Z4DCitN8-Dpu0aR2_Ygh5WrzP9jHkIUVgzAC7dUFP4q4uWs-B13qsNHLt5WEHdjCikGSvaR7joLGWoUVR6ebkj_V5iSOe6yPeL2RB84eXzxQBcPWbXTZQY3B4X8 Apr 17 10:56:14 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:56:14 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:56:14 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:56:14 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:56:14 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:56:14 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:56:14 user devstack@n-api.service[72745]: X-Project-Id: 652f9a7f20954e23b143e349c538f418 Apr 17 10:56:14 user devstack@n-api.service[72745]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1076174579 Apr 17 10:56:14 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:56:14 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:56:14 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/652f9a7f20954e23b143e349c538f418"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/652f9a7f20954e23b143e349c538f418"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/652f9a7f20954e23b143e349c538f418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:56:14 user devstack@n-api.service[72745]: X-Tenant: tempest-VolumesSnapshotTestJSON-1076174579 Apr 17 10:56:14 user devstack@n-api.service[72745]: X-Tenant-Id: 652f9a7f20954e23b143e349c538f418 Apr 17 10:56:14 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1076174579 Apr 17 10:56:14 user devstack@n-api.service[72745]: X-User: tempest-VolumesSnapshotTestJSON-1076174579-project-member Apr 17 10:56:14 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:56:14 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:56:14 user devstack@n-api.service[72745]: X-User-Id: 30ad2b6b478547e78e2cf273ef0390ed Apr 17 10:56:14 user devstack@n-api.service[72745]: X-User-Name: tempest-VolumesSnapshotTestJSON-1076174579-project-member Apr 17 10:56:14 user devstack@n-api.service[72745]: method: > Apr 17 10:56:14 user devstack@n-api.service[72745]: exception: Instance 0deb56c2-1224-488f-9d30-4082ec677dc7 could not be found. Apr 17 10:56:14 user devstack@n-api.service[72745]: action_args: {'id': '0deb56c2-1224-488f-9d30-4082ec677dc7'} Apr 17 10:56:14 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0deb56c2-1224-488f-9d30-4082ec677dc7 could not be found. Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0deb56c2-1224-488f-9d30-4082ec677dc7 could not be found. Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0deb56c2-1224-488f-9d30-4082ec677dc7 could not be found. Apr 17 10:56:14 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:56:14 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-8a3c0459-1add-4c2b-90d6-fa0229c3db03 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] Returning 404 to user: Instance 0deb56c2-1224-488f-9d30-4082ec677dc7 could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:56:14 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-8a3c0459-1add-4c2b-90d6-fa0229c3db03 tempest-VolumesSnapshotTestJSON-1076174579 tempest-VolumesSnapshotTestJSON-1076174579-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0deb56c2-1224-488f-9d30-4082ec677dc7" status: 404 len: 111 microversion: 2.1 time: 0.038440 Apr 17 10:56:14 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 288/841] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:56:14 2023] GET /compute/v2.1/servers/0deb56c2-1224-488f-9d30-4082ec677dc7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:56:19 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-a0626909-4e60-4f56-852a-90a4ffeb7805 req-8080eef8-a06e-4c4f-9197-70a7aa2e51e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38", "name": "network-vif-plugged", "status": "completed", "tag": "67386c8f-911d-4398-b449-42af25f6afe3"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:56:19 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:56:19 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:56:19 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:56:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-a0626909-4e60-4f56-852a-90a4ffeb7805 req-8080eef8-a06e-4c4f-9197-70a7aa2e51e3 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-a0626909-4e60-4f56-852a-90a4ffeb7805 req-8080eef8-a06e-4c4f-9197-70a7aa2e51e3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:19 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-a0626909-4e60-4f56-852a-90a4ffeb7805 req-8080eef8-a06e-4c4f-9197-70a7aa2e51e3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:19 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=17 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:56:19 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-a0626909-4e60-4f56-852a-90a4ffeb7805 req-8080eef8-a06e-4c4f-9197-70a7aa2e51e3 service nova] Creating event network-vif-plugged:67386c8f-911d-4398-b449-42af25f6afe3 for instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 on user Apr 17 10:56:19 user devstack@n-api.service[72743]: DEBUG nova.compute.api [req-a0626909-4e60-4f56-852a-90a4ffeb7805 req-8080eef8-a06e-4c4f-9197-70a7aa2e51e3 service nova] Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72743) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 17 10:56:19 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-a0626909-4e60-4f56-852a-90a4ffeb7805 req-8080eef8-a06e-4c4f-9197-70a7aa2e51e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042294 Apr 17 10:56:19 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 284/842] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:56:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:56:21 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:56:21 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=10 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:56:21 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-54651eba-2ed0-46d6-99e6-1122b9d6539b req-9fa98f27-e454-4d1a-8fda-c147df6b1fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38", "name": "network-vif-plugged", "status": "completed", "tag": "67386c8f-911d-4398-b449-42af25f6afe3"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:56:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-54651eba-2ed0-46d6-99e6-1122b9d6539b req-9fa98f27-e454-4d1a-8fda-c147df6b1fe6 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-54651eba-2ed0-46d6-99e6-1122b9d6539b req-9fa98f27-e454-4d1a-8fda-c147df6b1fe6 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-54651eba-2ed0-46d6-99e6-1122b9d6539b req-9fa98f27-e454-4d1a-8fda-c147df6b1fe6 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:21 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-54651eba-2ed0-46d6-99e6-1122b9d6539b req-9fa98f27-e454-4d1a-8fda-c147df6b1fe6 service nova] Creating event network-vif-plugged:67386c8f-911d-4398-b449-42af25f6afe3 for instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 on user Apr 17 10:56:21 user devstack@n-api.service[72744]: DEBUG nova.compute.api [req-54651eba-2ed0-46d6-99e6-1122b9d6539b req-9fa98f27-e454-4d1a-8fda-c147df6b1fe6 service nova] Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72744) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 17 10:56:21 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-54651eba-2ed0-46d6-99e6-1122b9d6539b req-9fa98f27-e454-4d1a-8fda-c147df6b1fe6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077746 Apr 17 10:56:21 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 271/843] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:56:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:56:28 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-75721c29-3cbc-464c-ac44-86dc9a28a140 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:56:28 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-75721c29-3cbc-464c-ac44-86dc9a28a140 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:56:29 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:56:29 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:56:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-75721c29-3cbc-464c-ac44-86dc9a28a140 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-75721c29-3cbc-464c-ac44-86dc9a28a140 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-75721c29-3cbc-464c-ac44-86dc9a28a140 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-75721c29-3cbc-464c-ac44-86dc9a28a140 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-75721c29-3cbc-464c-ac44-86dc9a28a140 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-75721c29-3cbc-464c-ac44-86dc9a28a140 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:29 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-75721c29-3cbc-464c-ac44-86dc9a28a140 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df693038f49145b9854ae18d246dde2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455ea6870abe450ba413ffabf4d4097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:56:29 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-75721c29-3cbc-464c-ac44-86dc9a28a140 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4" status: 200 len: 1536 microversion: 2.1 time: 0.271911 Apr 17 10:56:29 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 289/844] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:56:28 2023] GET /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4 => generated 1536 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 17 10:56:29 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-e877f786-2131-4075-acee-7246c51f0343 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:56:29 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-e877f786-2131-4075-acee-7246c51f0343 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'df693038f49145b9854ae18d246dde2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455ea6870abe450ba413ffabf4d4097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:56:29 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-e877f786-2131-4075-acee-7246c51f0343 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Searching by: {'deleted': False, 'project_id': '455ea6870abe450ba413ffabf4d4097e'} {{(pid=72743) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 17 10:56:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e877f786-2131-4075-acee-7246c51f0343 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e877f786-2131-4075-acee-7246c51f0343 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e877f786-2131-4075-acee-7246c51f0343 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e877f786-2131-4075-acee-7246c51f0343 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e877f786-2131-4075-acee-7246c51f0343 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e877f786-2131-4075-acee-7246c51f0343 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:29 user devstack@n-api.service[72743]: DEBUG nova.compute.multi_cell_list [None req-e877f786-2131-4075-acee-7246c51f0343 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=72743) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 17 10:56:29 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-e877f786-2131-4075-acee-7246c51f0343 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.086758 Apr 17 10:56:29 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 285/845] 10.0.0.210 () {62 vars in 1202 bytes} [Mon Apr 17 10:56:29 2023] GET /compute/v2.1/servers => generated 341 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:56:29 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-a6f66aee-d376-43d8-b5cc-06a2809178b0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:56:29 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-a6f66aee-d376-43d8-b5cc-06a2809178b0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:56:29 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a6f66aee-d376-43d8-b5cc-06a2809178b0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:29 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a6f66aee-d376-43d8-b5cc-06a2809178b0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:29 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a6f66aee-d376-43d8-b5cc-06a2809178b0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:29 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a6f66aee-d376-43d8-b5cc-06a2809178b0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:29 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a6f66aee-d376-43d8-b5cc-06a2809178b0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:29 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a6f66aee-d376-43d8-b5cc-06a2809178b0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:29 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-a6f66aee-d376-43d8-b5cc-06a2809178b0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df693038f49145b9854ae18d246dde2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455ea6870abe450ba413ffabf4d4097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:56:29 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-a6f66aee-d376-43d8-b5cc-06a2809178b0 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4" status: 200 len: 1536 microversion: 2.1 time: 0.217739 Apr 17 10:56:29 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 272/846] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:56:29 2023] GET /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4 => generated 1536 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:56:32 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c5f7bbd-005e-4a88-be2b-ff4f1cb86433"}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:56:32 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:56:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:32 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-d5eed27e-2d33-4199-8168-051869ab6ddd tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.438104 Apr 17 10:56:32 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 290/847] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Apr 17 10:56:32 2023] POST /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4/os-volume_attachments => generated 194 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:56:39 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-6a85ef44-3178-4a05-8735-10f65d6fe45b tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:56:39 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-6a85ef44-3178-4a05-8735-10f65d6fe45b tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:56:39 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=3 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:56:39 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:56:39 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=11 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:56:39 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6a85ef44-3178-4a05-8735-10f65d6fe45b tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:39 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6a85ef44-3178-4a05-8735-10f65d6fe45b tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:39 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6a85ef44-3178-4a05-8735-10f65d6fe45b tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:39 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6a85ef44-3178-4a05-8735-10f65d6fe45b tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:39 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6a85ef44-3178-4a05-8735-10f65d6fe45b tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:39 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-6a85ef44-3178-4a05-8735-10f65d6fe45b tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:39 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-6a85ef44-3178-4a05-8735-10f65d6fe45b tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:56:39 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-6a85ef44-3178-4a05-8735-10f65d6fe45b tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c0be0db8-2b49-43f1-8f6f-0f3c2d73e647" status: 200 len: 1551 microversion: 2.1 time: 0.230182 Apr 17 10:56:39 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 286/848] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:56:39 2023] GET /compute/v2.1/servers/c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 => generated 1551 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:56:40 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-224d03fb-3920-4381-ab69-6e29a1b7b4ad tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:56:40 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-224d03fb-3920-4381-ab69-6e29a1b7b4ad tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:56:40 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=4 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:56:40 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=10 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:56:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-224d03fb-3920-4381-ab69-6e29a1b7b4ad tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-224d03fb-3920-4381-ab69-6e29a1b7b4ad tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-224d03fb-3920-4381-ab69-6e29a1b7b4ad tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-224d03fb-3920-4381-ab69-6e29a1b7b4ad tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-224d03fb-3920-4381-ab69-6e29a1b7b4ad tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-224d03fb-3920-4381-ab69-6e29a1b7b4ad tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:40 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-224d03fb-3920-4381-ab69-6e29a1b7b4ad tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df693038f49145b9854ae18d246dde2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455ea6870abe450ba413ffabf4d4097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:56:40 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-224d03fb-3920-4381-ab69-6e29a1b7b4ad tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4" status: 200 len: 1582 microversion: 2.1 time: 0.239748 Apr 17 10:56:40 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 273/849] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:56:40 2023] GET /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4 => generated 1582 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:56:42 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-e717d9ea-645b-48ea-9f50-5f6264bb8ce9 req-0f2e67a8-3709-4db0-8226-535f08df7192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb68ad13-6870-417f-8593-4d41724109f4", "tag": "e139dcf1-9c53-4c70-849f-1a8126e4d347"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:56:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-e717d9ea-645b-48ea-9f50-5f6264bb8ce9 req-0f2e67a8-3709-4db0-8226-535f08df7192 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-e717d9ea-645b-48ea-9f50-5f6264bb8ce9 req-0f2e67a8-3709-4db0-8226-535f08df7192 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-e717d9ea-645b-48ea-9f50-5f6264bb8ce9 req-0f2e67a8-3709-4db0-8226-535f08df7192 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:42 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-e717d9ea-645b-48ea-9f50-5f6264bb8ce9 req-0f2e67a8-3709-4db0-8226-535f08df7192 service nova] Creating event network-changed:e139dcf1-9c53-4c70-849f-1a8126e4d347 for instance bb68ad13-6870-417f-8593-4d41724109f4 on user Apr 17 10:56:42 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-e717d9ea-645b-48ea-9f50-5f6264bb8ce9 req-0f2e67a8-3709-4db0-8226-535f08df7192 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089016 Apr 17 10:56:42 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 291/850] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:56:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:56:43 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-feee16dd-d5ed-4afd-aa8e-4d209e9ace4f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1556135619"}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:56:43 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-feee16dd-d5ed-4afd-aa8e-4d209e9ace4f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:56:43 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-feee16dd-d5ed-4afd-aa8e-4d209e9ace4f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:43 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-feee16dd-d5ed-4afd-aa8e-4d209e9ace4f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:43 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-feee16dd-d5ed-4afd-aa8e-4d209e9ace4f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:43 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-feee16dd-d5ed-4afd-aa8e-4d209e9ace4f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:43 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-feee16dd-d5ed-4afd-aa8e-4d209e9ace4f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:43 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-feee16dd-d5ed-4afd-aa8e-4d209e9ace4f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:43 user devstack@n-api.service[72743]: INFO nova.network.security_group_api [None req-feee16dd-d5ed-4afd-aa8e-4d209e9ace4f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Adding security group c15dd5e8-ed46-4dd0-b79a-3dd131b252dc to port e139dcf1-9c53-4c70-849f-1a8126e4d347 Apr 17 10:56:44 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-feee16dd-d5ed-4afd-aa8e-4d209e9ace4f tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4/action" status: 202 len: 0 microversion: 2.1 time: 0.886263 Apr 17 10:56:44 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 287/851] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 10:56:43 2023] POST /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4/action => generated 0 bytes in 888 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 17 10:56:44 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-1cd3e3cf-1573-4eb6-9828-4f8a65dd54a6 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:56:44 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-1cd3e3cf-1573-4eb6-9828-4f8a65dd54a6 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:56:44 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-6e495737-2d98-48c9-8862-8a494e1216c1 req-c1965fde-4c1c-43bd-b6f2-53d80bcf5c36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb68ad13-6870-417f-8593-4d41724109f4", "tag": "e139dcf1-9c53-4c70-849f-1a8126e4d347"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:56:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1cd3e3cf-1573-4eb6-9828-4f8a65dd54a6 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1cd3e3cf-1573-4eb6-9828-4f8a65dd54a6 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1cd3e3cf-1573-4eb6-9828-4f8a65dd54a6 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1cd3e3cf-1573-4eb6-9828-4f8a65dd54a6 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1cd3e3cf-1573-4eb6-9828-4f8a65dd54a6 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1cd3e3cf-1573-4eb6-9828-4f8a65dd54a6 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:44 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-6e495737-2d98-48c9-8862-8a494e1216c1 req-c1965fde-4c1c-43bd-b6f2-53d80bcf5c36 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:44 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-6e495737-2d98-48c9-8862-8a494e1216c1 req-c1965fde-4c1c-43bd-b6f2-53d80bcf5c36 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:44 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-6e495737-2d98-48c9-8862-8a494e1216c1 req-c1965fde-4c1c-43bd-b6f2-53d80bcf5c36 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:44 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-6e495737-2d98-48c9-8862-8a494e1216c1 req-c1965fde-4c1c-43bd-b6f2-53d80bcf5c36 service nova] Creating event network-changed:e139dcf1-9c53-4c70-849f-1a8126e4d347 for instance bb68ad13-6870-417f-8593-4d41724109f4 on user Apr 17 10:56:44 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-6e495737-2d98-48c9-8862-8a494e1216c1 req-c1965fde-4c1c-43bd-b6f2-53d80bcf5c36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032573 Apr 17 10:56:44 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 292/852] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:56:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:56:44 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-1cd3e3cf-1573-4eb6-9828-4f8a65dd54a6 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df693038f49145b9854ae18d246dde2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455ea6870abe450ba413ffabf4d4097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:56:44 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-1cd3e3cf-1573-4eb6-9828-4f8a65dd54a6 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4" status: 200 len: 1748 microversion: 2.1 time: 0.228952 Apr 17 10:56:44 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 274/853] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:56:44 2023] GET /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4 => generated 1748 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 17 10:56:44 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-c5ee6555-3242-4fc0-ba3c-9b6bbfe672ef tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:56:44 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-c5ee6555-3242-4fc0-ba3c-9b6bbfe672ef tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:56:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c5ee6555-3242-4fc0-ba3c-9b6bbfe672ef tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c5ee6555-3242-4fc0-ba3c-9b6bbfe672ef tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c5ee6555-3242-4fc0-ba3c-9b6bbfe672ef tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c5ee6555-3242-4fc0-ba3c-9b6bbfe672ef tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c5ee6555-3242-4fc0-ba3c-9b6bbfe672ef tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c5ee6555-3242-4fc0-ba3c-9b6bbfe672ef tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:44 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-c5ee6555-3242-4fc0-ba3c-9b6bbfe672ef tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4/action" status: 202 len: 0 microversion: 2.1 time: 0.092945 Apr 17 10:56:44 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 288/854] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 10:56:44 2023] POST /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:56:44 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-4e6ffb58-8754-4f3d-8086-88425862ba21 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:56:44 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-4e6ffb58-8754-4f3d-8086-88425862ba21 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:56:44 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4e6ffb58-8754-4f3d-8086-88425862ba21 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:44 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4e6ffb58-8754-4f3d-8086-88425862ba21 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:44 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4e6ffb58-8754-4f3d-8086-88425862ba21 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:44 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4e6ffb58-8754-4f3d-8086-88425862ba21 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:44 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4e6ffb58-8754-4f3d-8086-88425862ba21 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:44 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4e6ffb58-8754-4f3d-8086-88425862ba21 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:45 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-4e6ffb58-8754-4f3d-8086-88425862ba21 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df693038f49145b9854ae18d246dde2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455ea6870abe450ba413ffabf4d4097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:56:45 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-4e6ffb58-8754-4f3d-8086-88425862ba21 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4" status: 200 len: 1740 microversion: 2.1 time: 0.282629 Apr 17 10:56:45 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 293/855] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:56:44 2023] GET /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4 => generated 1740 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:56:48 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-522c414a-14d7-4694-a8ee-99578ec0ff45 req-9c0f16c8-9ec4-45a7-baf4-256250c4252b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb68ad13-6870-417f-8593-4d41724109f4", "name": "network-vif-unplugged", "status": "completed", "tag": "e139dcf1-9c53-4c70-849f-1a8126e4d347"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:56:48 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-522c414a-14d7-4694-a8ee-99578ec0ff45 req-9c0f16c8-9ec4-45a7-baf4-256250c4252b service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:48 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-522c414a-14d7-4694-a8ee-99578ec0ff45 req-9c0f16c8-9ec4-45a7-baf4-256250c4252b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:48 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-522c414a-14d7-4694-a8ee-99578ec0ff45 req-9c0f16c8-9ec4-45a7-baf4-256250c4252b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:48 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-522c414a-14d7-4694-a8ee-99578ec0ff45 req-9c0f16c8-9ec4-45a7-baf4-256250c4252b service nova] Creating event network-vif-unplugged:e139dcf1-9c53-4c70-849f-1a8126e4d347 for instance bb68ad13-6870-417f-8593-4d41724109f4 on user Apr 17 10:56:48 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-522c414a-14d7-4694-a8ee-99578ec0ff45 req-9c0f16c8-9ec4-45a7-baf4-256250c4252b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.203789 Apr 17 10:56:48 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 275/856] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:56:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:56:50 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-4374bf10-0a0f-4dbf-b4e4-f5e0965e2583 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:56:50 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-2a3316e5-f233-49e5-9068-b409613bf148 req-2fc7d1d2-508a-4b67-9846-a1e1d8d95dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb68ad13-6870-417f-8593-4d41724109f4", "name": "network-vif-plugged", "status": "completed", "tag": "e139dcf1-9c53-4c70-849f-1a8126e4d347"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:56:50 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-4374bf10-0a0f-4dbf-b4e4-f5e0965e2583 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:56:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4374bf10-0a0f-4dbf-b4e4-f5e0965e2583 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4374bf10-0a0f-4dbf-b4e4-f5e0965e2583 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4374bf10-0a0f-4dbf-b4e4-f5e0965e2583 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-2a3316e5-f233-49e5-9068-b409613bf148 req-2fc7d1d2-508a-4b67-9846-a1e1d8d95dc3 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-2a3316e5-f233-49e5-9068-b409613bf148 req-2fc7d1d2-508a-4b67-9846-a1e1d8d95dc3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4374bf10-0a0f-4dbf-b4e4-f5e0965e2583 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4374bf10-0a0f-4dbf-b4e4-f5e0965e2583 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-2a3316e5-f233-49e5-9068-b409613bf148 req-2fc7d1d2-508a-4b67-9846-a1e1d8d95dc3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4374bf10-0a0f-4dbf-b4e4-f5e0965e2583 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:50 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-2a3316e5-f233-49e5-9068-b409613bf148 req-2fc7d1d2-508a-4b67-9846-a1e1d8d95dc3 service nova] Creating event network-vif-plugged:e139dcf1-9c53-4c70-849f-1a8126e4d347 for instance bb68ad13-6870-417f-8593-4d41724109f4 on user Apr 17 10:56:50 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-2a3316e5-f233-49e5-9068-b409613bf148 req-2fc7d1d2-508a-4b67-9846-a1e1d8d95dc3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053316 Apr 17 10:56:50 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 294/857] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:56:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:56:50 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-4374bf10-0a0f-4dbf-b4e4-f5e0965e2583 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c15ce534a649ae8a971b33221e2500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747b7d3c6844772b0e6eed5299053ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:56:50 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-4374bf10-0a0f-4dbf-b4e4-f5e0965e2583 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/385a180f-e722-4826-a6e0-47608461e66e" status: 200 len: 1502 microversion: 2.1 time: 0.278612 Apr 17 10:56:50 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 289/858] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:56:50 2023] GET /compute/v2.1/servers/385a180f-e722-4826-a6e0-47608461e66e => generated 1502 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:56:52 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-04d3351e-57fd-4051-a32a-76f393583149 req-81b3d75e-c7d0-4e1d-b8fb-16e8149ca353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb68ad13-6870-417f-8593-4d41724109f4", "name": "network-vif-plugged", "status": "completed", "tag": "e139dcf1-9c53-4c70-849f-1a8126e4d347"}, {"server_uuid": "bb68ad13-6870-417f-8593-4d41724109f4", "name": "network-vif-plugged", "status": "completed", "tag": "e139dcf1-9c53-4c70-849f-1a8126e4d347"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:56:52 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-04d3351e-57fd-4051-a32a-76f393583149 req-81b3d75e-c7d0-4e1d-b8fb-16e8149ca353 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:52 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-04d3351e-57fd-4051-a32a-76f393583149 req-81b3d75e-c7d0-4e1d-b8fb-16e8149ca353 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:52 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-04d3351e-57fd-4051-a32a-76f393583149 req-81b3d75e-c7d0-4e1d-b8fb-16e8149ca353 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:52 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-04d3351e-57fd-4051-a32a-76f393583149 req-81b3d75e-c7d0-4e1d-b8fb-16e8149ca353 service nova] Creating event network-vif-plugged:e139dcf1-9c53-4c70-849f-1a8126e4d347 for instance bb68ad13-6870-417f-8593-4d41724109f4 on user Apr 17 10:56:52 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-04d3351e-57fd-4051-a32a-76f393583149 req-81b3d75e-c7d0-4e1d-b8fb-16e8149ca353 service nova] Creating event network-vif-plugged:e139dcf1-9c53-4c70-849f-1a8126e4d347 for instance bb68ad13-6870-417f-8593-4d41724109f4 on user Apr 17 10:56:52 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-04d3351e-57fd-4051-a32a-76f393583149 req-81b3d75e-c7d0-4e1d-b8fb-16e8149ca353 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041741 Apr 17 10:56:52 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 276/859] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:56:52 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:56:57 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-09898211-6d4e-4c32-b2aa-5c1575020f48 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:56:57 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-09898211-6d4e-4c32-b2aa-5c1575020f48 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:56:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-09898211-6d4e-4c32-b2aa-5c1575020f48 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-09898211-6d4e-4c32-b2aa-5c1575020f48 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-09898211-6d4e-4c32-b2aa-5c1575020f48 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-09898211-6d4e-4c32-b2aa-5c1575020f48 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:56:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-09898211-6d4e-4c32-b2aa-5c1575020f48 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:56:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-09898211-6d4e-4c32-b2aa-5c1575020f48 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:56:57 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-09898211-6d4e-4c32-b2aa-5c1575020f48 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:56:57 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-09898211-6d4e-4c32-b2aa-5c1575020f48 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 200 len: 1721 microversion: 2.1 time: 0.235889 Apr 17 10:56:57 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 295/860] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:56:57 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:57:35 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-313a9d77-046f-4c5d-831b-8ae0b58c4664 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:57:35 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-313a9d77-046f-4c5d-831b-8ae0b58c4664 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:57:35 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=8 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:57:35 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:57:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-313a9d77-046f-4c5d-831b-8ae0b58c4664 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:57:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-313a9d77-046f-4c5d-831b-8ae0b58c4664 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:57:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-313a9d77-046f-4c5d-831b-8ae0b58c4664 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:57:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-313a9d77-046f-4c5d-831b-8ae0b58c4664 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:57:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-313a9d77-046f-4c5d-831b-8ae0b58c4664 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:57:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-313a9d77-046f-4c5d-831b-8ae0b58c4664 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:57:35 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-313a9d77-046f-4c5d-831b-8ae0b58c4664 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df693038f49145b9854ae18d246dde2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455ea6870abe450ba413ffabf4d4097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:57:35 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-313a9d77-046f-4c5d-831b-8ae0b58c4664 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4" status: 200 len: 1748 microversion: 2.1 time: 0.240551 Apr 17 10:57:35 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 290/861] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:57:35 2023] GET /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4 => generated 1748 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:57:40 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=8 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:57:40 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=16 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:57:40 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-a3026730-3570-43bc-8798-39cf74f4299b tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:57:40 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-a3026730-3570-43bc-8798-39cf74f4299b tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:57:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a3026730-3570-43bc-8798-39cf74f4299b tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:57:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a3026730-3570-43bc-8798-39cf74f4299b tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:57:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a3026730-3570-43bc-8798-39cf74f4299b tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:57:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a3026730-3570-43bc-8798-39cf74f4299b tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:57:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a3026730-3570-43bc-8798-39cf74f4299b tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:57:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a3026730-3570-43bc-8798-39cf74f4299b tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:57:40 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-a3026730-3570-43bc-8798-39cf74f4299b tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:57:40 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-a3026730-3570-43bc-8798-39cf74f4299b tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c0be0db8-2b49-43f1-8f6f-0f3c2d73e647" status: 200 len: 1551 microversion: 2.1 time: 0.273100 Apr 17 10:57:40 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 277/862] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:57:40 2023] GET /compute/v2.1/servers/c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 => generated 1551 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:57:40 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:57:40 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:57:40 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=14 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:57:40 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:57:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:57:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:57:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:57:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:57:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:57:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:57:40 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Going to try to terminate instance {{(pid=72745) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:57:40 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-09295aa2-f950-4213-b21e-dc3378df9c93 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c0be0db8-2b49-43f1-8f6f-0f3c2d73e647" status: 204 len: 0 microversion: 2.1 time: 0.132291 Apr 17 10:57:40 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 296/863] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:57:40 2023] DELETE /compute/v2.1/servers/c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:57:40 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-e895dc9c-8704-4076-8a82-9a9dd002af55 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:57:40 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-e895dc9c-8704-4076-8a82-9a9dd002af55 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:57:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e895dc9c-8704-4076-8a82-9a9dd002af55 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:57:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e895dc9c-8704-4076-8a82-9a9dd002af55 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:57:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e895dc9c-8704-4076-8a82-9a9dd002af55 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:57:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e895dc9c-8704-4076-8a82-9a9dd002af55 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:57:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e895dc9c-8704-4076-8a82-9a9dd002af55 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:57:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e895dc9c-8704-4076-8a82-9a9dd002af55 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:57:40 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-10358414-0b77-4ec8-af62-81799c52fe13 req-2a13e0f2-a42a-42c6-bccd-61204ddf45f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0be0db8-2b49-43f1-8f6f-0f3c2d73e647", "name": "network-vif-unplugged", "status": "completed", "tag": "ff468c15-f042-4b7c-8f06-903bb2b72b09"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:57:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-10358414-0b77-4ec8-af62-81799c52fe13 req-2a13e0f2-a42a-42c6-bccd-61204ddf45f2 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:57:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-10358414-0b77-4ec8-af62-81799c52fe13 req-2a13e0f2-a42a-42c6-bccd-61204ddf45f2 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:57:40 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-10358414-0b77-4ec8-af62-81799c52fe13 req-2a13e0f2-a42a-42c6-bccd-61204ddf45f2 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:57:40 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-10358414-0b77-4ec8-af62-81799c52fe13 req-2a13e0f2-a42a-42c6-bccd-61204ddf45f2 service nova] Creating event network-vif-unplugged:ff468c15-f042-4b7c-8f06-903bb2b72b09 for instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 on user Apr 17 10:57:40 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-10358414-0b77-4ec8-af62-81799c52fe13 req-2a13e0f2-a42a-42c6-bccd-61204ddf45f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037128 Apr 17 10:57:40 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 278/864] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:57:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 10:57:40 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-e895dc9c-8704-4076-8a82-9a9dd002af55 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:57:40 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-e895dc9c-8704-4076-8a82-9a9dd002af55 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c0be0db8-2b49-43f1-8f6f-0f3c2d73e647" status: 200 len: 1557 microversion: 2.1 time: 0.282329 Apr 17 10:57:40 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 291/865] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:57:40 2023] GET /compute/v2.1/servers/c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 => generated 1557 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:57:42 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-9096c46c-14bf-4bdb-8498-76678e9c4e37 req-857b0955-5113-4e81-bebe-59636f57a7f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0be0db8-2b49-43f1-8f6f-0f3c2d73e647", "name": "network-vif-deleted", "tag": "ff468c15-f042-4b7c-8f06-903bb2b72b09"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:57:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-9096c46c-14bf-4bdb-8498-76678e9c4e37 req-857b0955-5113-4e81-bebe-59636f57a7f1 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:57:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-9096c46c-14bf-4bdb-8498-76678e9c4e37 req-857b0955-5113-4e81-bebe-59636f57a7f1 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:57:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-9096c46c-14bf-4bdb-8498-76678e9c4e37 req-857b0955-5113-4e81-bebe-59636f57a7f1 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:57:42 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-9096c46c-14bf-4bdb-8498-76678e9c4e37 req-857b0955-5113-4e81-bebe-59636f57a7f1 service nova] Creating event network-vif-deleted:ff468c15-f042-4b7c-8f06-903bb2b72b09 for instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 on user Apr 17 10:57:42 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-9096c46c-14bf-4bdb-8498-76678e9c4e37 req-857b0955-5113-4e81-bebe-59636f57a7f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030281 Apr 17 10:57:42 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 297/866] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:57:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:57:42 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-b7701734-dab6-4590-817f-44c21598468d req-c830e9b2-b539-4d2d-ad0a-7066e49c1e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0be0db8-2b49-43f1-8f6f-0f3c2d73e647", "name": "network-vif-plugged", "status": "completed", "tag": "ff468c15-f042-4b7c-8f06-903bb2b72b09"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:57:42 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-b7701734-dab6-4590-817f-44c21598468d req-c830e9b2-b539-4d2d-ad0a-7066e49c1e76 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:57:42 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-b7701734-dab6-4590-817f-44c21598468d req-c830e9b2-b539-4d2d-ad0a-7066e49c1e76 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:57:42 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-b7701734-dab6-4590-817f-44c21598468d req-c830e9b2-b539-4d2d-ad0a-7066e49c1e76 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:57:42 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-b7701734-dab6-4590-817f-44c21598468d req-c830e9b2-b539-4d2d-ad0a-7066e49c1e76 service nova] Creating event network-vif-plugged:ff468c15-f042-4b7c-8f06-903bb2b72b09 for instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 on user Apr 17 10:57:42 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-b7701734-dab6-4590-817f-44c21598468d req-c830e9b2-b539-4d2d-ad0a-7066e49c1e76 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030906 Apr 17 10:57:42 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 279/867] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:57:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:57:50 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:57:50 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:57:50 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=4 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:57:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:57:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:57:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:57:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:57:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:57:50 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:57:50 user devstack@n-api.service[72743]: DEBUG nova.objects.instance [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'flavor' on Instance uuid 385a180f-e722-4826-a6e0-47608461e66e {{(pid=72743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 10:57:50 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-b2ace779-07e4-4f02-ad80-d5974c8ef5a3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "POST /compute/v2.1/servers/385a180f-e722-4826-a6e0-47608461e66e/action" status: 200 len: 32 microversion: 2.1 time: 0.109634 Apr 17 10:57:50 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 292/868] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 10:57:50 2023] POST /compute/v2.1/servers/385a180f-e722-4826-a6e0-47608461e66e/action => generated 32 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 17 10:57:50 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-613e08ea-746d-4b24-a03a-4f6a43e6bf30 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:57:50 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-613e08ea-746d-4b24-a03a-4f6a43e6bf30 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:57:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-613e08ea-746d-4b24-a03a-4f6a43e6bf30 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:57:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-613e08ea-746d-4b24-a03a-4f6a43e6bf30 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:57:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-613e08ea-746d-4b24-a03a-4f6a43e6bf30 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:57:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-613e08ea-746d-4b24-a03a-4f6a43e6bf30 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:57:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-613e08ea-746d-4b24-a03a-4f6a43e6bf30 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:57:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-613e08ea-746d-4b24-a03a-4f6a43e6bf30 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:57:50 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-613e08ea-746d-4b24-a03a-4f6a43e6bf30 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c15ce534a649ae8a971b33221e2500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747b7d3c6844772b0e6eed5299053ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:57:50 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-613e08ea-746d-4b24-a03a-4f6a43e6bf30 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/385a180f-e722-4826-a6e0-47608461e66e" status: 200 len: 1508 microversion: 2.1 time: 0.215725 Apr 17 10:57:50 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 298/869] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:57:50 2023] GET /compute/v2.1/servers/385a180f-e722-4826-a6e0-47608461e66e => generated 1508 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:57:51 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-a765d4f9-3c1b-4ff5-85ed-b338522fbc29 req-b184ee9a-31d3-4d23-a8e8-7e626a4e612f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "385a180f-e722-4826-a6e0-47608461e66e", "name": "network-vif-unplugged", "status": "completed", "tag": "8fca060e-eb45-4132-9515-99574c15e1a0"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:57:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-a765d4f9-3c1b-4ff5-85ed-b338522fbc29 req-b184ee9a-31d3-4d23-a8e8-7e626a4e612f service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:57:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-a765d4f9-3c1b-4ff5-85ed-b338522fbc29 req-b184ee9a-31d3-4d23-a8e8-7e626a4e612f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:57:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-a765d4f9-3c1b-4ff5-85ed-b338522fbc29 req-b184ee9a-31d3-4d23-a8e8-7e626a4e612f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:57:51 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-a765d4f9-3c1b-4ff5-85ed-b338522fbc29 req-b184ee9a-31d3-4d23-a8e8-7e626a4e612f service nova] Creating event network-vif-unplugged:8fca060e-eb45-4132-9515-99574c15e1a0 for instance 385a180f-e722-4826-a6e0-47608461e66e on user Apr 17 10:57:51 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-a765d4f9-3c1b-4ff5-85ed-b338522fbc29 req-b184ee9a-31d3-4d23-a8e8-7e626a4e612f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036149 Apr 17 10:57:51 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 280/870] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:57:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:57:53 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-c77be9bf-23dd-47fc-a4cd-22ecf1b499be req-6a33ab9a-cf55-41b1-a134-4501ad4ecbca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "385a180f-e722-4826-a6e0-47608461e66e", "name": "network-vif-plugged", "status": "completed", "tag": "8fca060e-eb45-4132-9515-99574c15e1a0"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:57:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-c77be9bf-23dd-47fc-a4cd-22ecf1b499be req-6a33ab9a-cf55-41b1-a134-4501ad4ecbca service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:57:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-c77be9bf-23dd-47fc-a4cd-22ecf1b499be req-6a33ab9a-cf55-41b1-a134-4501ad4ecbca service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:57:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-c77be9bf-23dd-47fc-a4cd-22ecf1b499be req-6a33ab9a-cf55-41b1-a134-4501ad4ecbca service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:57:53 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-c77be9bf-23dd-47fc-a4cd-22ecf1b499be req-6a33ab9a-cf55-41b1-a134-4501ad4ecbca service nova] Creating event network-vif-plugged:8fca060e-eb45-4132-9515-99574c15e1a0 for instance 385a180f-e722-4826-a6e0-47608461e66e on user Apr 17 10:57:53 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-c77be9bf-23dd-47fc-a4cd-22ecf1b499be req-6a33ab9a-cf55-41b1-a134-4501ad4ecbca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040521 Apr 17 10:57:53 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 293/871] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:57:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:57:55 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-97c819ed-e996-4cca-b18e-a31f5ad8d5b7 req-7d2607e6-0785-46ae-9463-97c4bc16ce66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "385a180f-e722-4826-a6e0-47608461e66e", "name": "network-vif-plugged", "status": "completed", "tag": "8fca060e-eb45-4132-9515-99574c15e1a0"}, {"server_uuid": "385a180f-e722-4826-a6e0-47608461e66e", "name": "network-vif-plugged", "status": "completed", "tag": "8fca060e-eb45-4132-9515-99574c15e1a0"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:57:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-97c819ed-e996-4cca-b18e-a31f5ad8d5b7 req-7d2607e6-0785-46ae-9463-97c4bc16ce66 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:57:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-97c819ed-e996-4cca-b18e-a31f5ad8d5b7 req-7d2607e6-0785-46ae-9463-97c4bc16ce66 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:57:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-97c819ed-e996-4cca-b18e-a31f5ad8d5b7 req-7d2607e6-0785-46ae-9463-97c4bc16ce66 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:57:55 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-97c819ed-e996-4cca-b18e-a31f5ad8d5b7 req-7d2607e6-0785-46ae-9463-97c4bc16ce66 service nova] Creating event network-vif-plugged:8fca060e-eb45-4132-9515-99574c15e1a0 for instance 385a180f-e722-4826-a6e0-47608461e66e on user Apr 17 10:57:55 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-97c819ed-e996-4cca-b18e-a31f5ad8d5b7 req-7d2607e6-0785-46ae-9463-97c4bc16ce66 service nova] Creating event network-vif-plugged:8fca060e-eb45-4132-9515-99574c15e1a0 for instance 385a180f-e722-4826-a6e0-47608461e66e on user Apr 17 10:57:55 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-97c819ed-e996-4cca-b18e-a31f5ad8d5b7 req-7d2607e6-0785-46ae-9463-97c4bc16ce66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032437 Apr 17 10:57:55 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 299/872] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:57:55 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 10:57:57 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-39c09876-e58f-419a-9df2-fb04997dadaf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:57:57 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-39c09876-e58f-419a-9df2-fb04997dadaf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:57:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-39c09876-e58f-419a-9df2-fb04997dadaf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:57:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-39c09876-e58f-419a-9df2-fb04997dadaf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:57:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-39c09876-e58f-419a-9df2-fb04997dadaf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:57:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-39c09876-e58f-419a-9df2-fb04997dadaf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:57:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-39c09876-e58f-419a-9df2-fb04997dadaf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:57:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-39c09876-e58f-419a-9df2-fb04997dadaf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:57:57 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-39c09876-e58f-419a-9df2-fb04997dadaf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:57:57 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-39c09876-e58f-419a-9df2-fb04997dadaf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 200 len: 1721 microversion: 2.1 time: 0.222220 Apr 17 10:57:57 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 281/873] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:57:57 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:57:57 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-58f1d3d7-7b57-413e-ab11-834ccbd92cc6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:57:57 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-58f1d3d7-7b57-413e-ab11-834ccbd92cc6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:57:57 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-58f1d3d7-7b57-413e-ab11-834ccbd92cc6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:57:57 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-58f1d3d7-7b57-413e-ab11-834ccbd92cc6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:57:57 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-58f1d3d7-7b57-413e-ab11-834ccbd92cc6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:57:57 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-58f1d3d7-7b57-413e-ab11-834ccbd92cc6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:57:57 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-58f1d3d7-7b57-413e-ab11-834ccbd92cc6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:57:57 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-58f1d3d7-7b57-413e-ab11-834ccbd92cc6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:57:57 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-58f1d3d7-7b57-413e-ab11-834ccbd92cc6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:57:57 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-58f1d3d7-7b57-413e-ab11-834ccbd92cc6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 200 len: 1721 microversion: 2.1 time: 0.145321 Apr 17 10:57:57 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 294/874] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:57:57 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:58:30 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:58:30 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:58:30 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-c74fbedd-c5d8-4496-9575-bfdec6de5613 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:58:30 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-c74fbedd-c5d8-4496-9575-bfdec6de5613 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:58:30 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c74fbedd-c5d8-4496-9575-bfdec6de5613 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:58:30 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c74fbedd-c5d8-4496-9575-bfdec6de5613 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:58:30 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c74fbedd-c5d8-4496-9575-bfdec6de5613 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:58:30 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c74fbedd-c5d8-4496-9575-bfdec6de5613 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:58:30 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c74fbedd-c5d8-4496-9575-bfdec6de5613 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:58:30 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c74fbedd-c5d8-4496-9575-bfdec6de5613 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:58:30 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-c74fbedd-c5d8-4496-9575-bfdec6de5613 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] HTTP exception thrown: Instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 could not be found. Apr 17 10:58:30 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-c74fbedd-c5d8-4496-9575-bfdec6de5613 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Request method failure captured: Apr 17 10:58:30 user devstack@n-api.service[72745]: request: GET /compute/v2.1/servers/c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 HTTP/1.1 Apr 17 10:58:30 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:58:30 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:58:30 user devstack@n-api.service[72745]: Connection: close Apr 17 10:58:30 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 10:58:30 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:58:30 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:58:30 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:58:30 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:58:30 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSSCVaY1iKFmkIuE91AAZWbZr-St_d2GFFrNXSeGSoQiDrm-J9xeGchCURDcBT2f6OJKR7j1O2xqpvL6Q1v7RUTS6S0coDZzk4yo8dpwf8dH_RMLU-Nova4o6mAYcBGkp1ZyRONF4za9zTxaNNTE8dZP8s8iS--XIiCu-N56JXP7Shg Apr 17 10:58:30 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:58:30 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:58:30 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:58:30 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:58:30 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:58:30 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:58:30 user devstack@n-api.service[72745]: X-Project-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 10:58:30 user devstack@n-api.service[72745]: X-Project-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 10:58:30 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:58:30 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:58:30 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:58:30 user devstack@n-api.service[72745]: X-Tenant: tempest-TestVolumeBootPattern-1777404437 Apr 17 10:58:30 user devstack@n-api.service[72745]: X-Tenant-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 10:58:30 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 10:58:30 user devstack@n-api.service[72745]: X-User: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 10:58:30 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:58:30 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:58:30 user devstack@n-api.service[72745]: X-User-Id: 0e4ed1192974484bba2d4392f4d011c2 Apr 17 10:58:30 user devstack@n-api.service[72745]: X-User-Name: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 10:58:30 user devstack@n-api.service[72745]: method: > Apr 17 10:58:30 user devstack@n-api.service[72745]: exception: Instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 could not be found. Apr 17 10:58:30 user devstack@n-api.service[72745]: action_args: {'id': 'c0be0db8-2b49-43f1-8f6f-0f3c2d73e647'} Apr 17 10:58:30 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 could not be found. Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 could not be found. Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 could not be found. Apr 17 10:58:30 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:58:30 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-c74fbedd-c5d8-4496-9575-bfdec6de5613 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Returning 404 to user: Instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:58:30 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-c74fbedd-c5d8-4496-9575-bfdec6de5613 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c0be0db8-2b49-43f1-8f6f-0f3c2d73e647" status: 404 len: 111 microversion: 2.1 time: 0.054802 Apr 17 10:58:30 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 300/875] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:58:30 2023] GET /compute/v2.1/servers/c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:58:34 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:58:34 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:58:34 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=10 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:58:34 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=18 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:58:34 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:58:34 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:58:34 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:58:34 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:58:34 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:58:34 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:58:34 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Going to try to terminate instance {{(pid=72744) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:58:34 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-606c39a6-d645-470f-887e-d1941124c9c4 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/109ee5e0-8c02-43c2-9415-48bb0c8c3a06" status: 204 len: 0 microversion: 2.1 time: 0.116508 Apr 17 10:58:34 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 282/876] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:58:34 2023] DELETE /compute/v2.1/servers/109ee5e0-8c02-43c2-9415-48bb0c8c3a06 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:58:34 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-547c87bd-61cd-4d77-834e-b68a008cb9b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:58:34 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-547c87bd-61cd-4d77-834e-b68a008cb9b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:58:34 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:58:34 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:58:34 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-547c87bd-61cd-4d77-834e-b68a008cb9b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:58:34 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-547c87bd-61cd-4d77-834e-b68a008cb9b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:58:34 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-547c87bd-61cd-4d77-834e-b68a008cb9b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:58:34 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-547c87bd-61cd-4d77-834e-b68a008cb9b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:58:34 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-547c87bd-61cd-4d77-834e-b68a008cb9b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:58:34 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-547c87bd-61cd-4d77-834e-b68a008cb9b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:58:34 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-ef3faf4b-d0d2-4ad3-93dc-8d36708baac8 req-9ad4fa70-656e-4541-a0b3-72fe90ab7b4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "109ee5e0-8c02-43c2-9415-48bb0c8c3a06", "name": "network-vif-unplugged", "status": "completed", "tag": "d4f89575-0631-4344-ac9f-dfb2211df9a0"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:58:34 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-547c87bd-61cd-4d77-834e-b68a008cb9b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:58:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-ef3faf4b-d0d2-4ad3-93dc-8d36708baac8 req-9ad4fa70-656e-4541-a0b3-72fe90ab7b4a service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:58:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-ef3faf4b-d0d2-4ad3-93dc-8d36708baac8 req-9ad4fa70-656e-4541-a0b3-72fe90ab7b4a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:58:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-ef3faf4b-d0d2-4ad3-93dc-8d36708baac8 req-9ad4fa70-656e-4541-a0b3-72fe90ab7b4a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:58:34 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-547c87bd-61cd-4d77-834e-b68a008cb9b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/109ee5e0-8c02-43c2-9415-48bb0c8c3a06" status: 200 len: 1400 microversion: 2.1 time: 0.274539 Apr 17 10:58:34 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 295/877] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:58:34 2023] GET /compute/v2.1/servers/109ee5e0-8c02-43c2-9415-48bb0c8c3a06 => generated 1400 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:58:34 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-ef3faf4b-d0d2-4ad3-93dc-8d36708baac8 req-9ad4fa70-656e-4541-a0b3-72fe90ab7b4a service nova] Creating event network-vif-unplugged:d4f89575-0631-4344-ac9f-dfb2211df9a0 for instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 on user Apr 17 10:58:34 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-ef3faf4b-d0d2-4ad3-93dc-8d36708baac8 req-9ad4fa70-656e-4541-a0b3-72fe90ab7b4a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044657 Apr 17 10:58:34 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 301/878] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:58:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 10:58:35 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-7e2e4682-fffb-4293-bbfb-776d0dad20ed tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1556135619"}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:58:35 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-7e2e4682-fffb-4293-bbfb-776d0dad20ed tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:58:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7e2e4682-fffb-4293-bbfb-776d0dad20ed tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:58:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7e2e4682-fffb-4293-bbfb-776d0dad20ed tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:58:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7e2e4682-fffb-4293-bbfb-776d0dad20ed tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:58:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7e2e4682-fffb-4293-bbfb-776d0dad20ed tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:58:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7e2e4682-fffb-4293-bbfb-776d0dad20ed tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:58:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7e2e4682-fffb-4293-bbfb-776d0dad20ed tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:58:36 user devstack@n-api.service[72744]: INFO nova.network.security_group_api [None req-7e2e4682-fffb-4293-bbfb-776d0dad20ed tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Removing security group c15dd5e8-ed46-4dd0-b79a-3dd131b252dc from port e139dcf1-9c53-4c70-849f-1a8126e4d347 Apr 17 10:58:36 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-87e2531a-0d78-41bc-a340-5ea40e9900c7 req-b8dc4248-cc4a-4d2a-9137-5cb09d796a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "109ee5e0-8c02-43c2-9415-48bb0c8c3a06", "name": "network-vif-plugged", "status": "completed", "tag": "d4f89575-0631-4344-ac9f-dfb2211df9a0"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:58:36 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-87e2531a-0d78-41bc-a340-5ea40e9900c7 req-b8dc4248-cc4a-4d2a-9137-5cb09d796a95 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:58:36 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-87e2531a-0d78-41bc-a340-5ea40e9900c7 req-b8dc4248-cc4a-4d2a-9137-5cb09d796a95 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:58:36 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-87e2531a-0d78-41bc-a340-5ea40e9900c7 req-b8dc4248-cc4a-4d2a-9137-5cb09d796a95 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:58:36 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-31568c39-6bf9-42c5-89a2-95745871cfae req-47bae5af-57ec-4132-9275-f9a8fc1d9d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "109ee5e0-8c02-43c2-9415-48bb0c8c3a06", "name": "network-vif-deleted", "tag": "d4f89575-0631-4344-ac9f-dfb2211df9a0"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:58:36 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-87e2531a-0d78-41bc-a340-5ea40e9900c7 req-b8dc4248-cc4a-4d2a-9137-5cb09d796a95 service nova] Creating event network-vif-plugged:d4f89575-0631-4344-ac9f-dfb2211df9a0 for instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 on user Apr 17 10:58:36 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-31568c39-6bf9-42c5-89a2-95745871cfae req-47bae5af-57ec-4132-9275-f9a8fc1d9d92 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:58:36 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-31568c39-6bf9-42c5-89a2-95745871cfae req-47bae5af-57ec-4132-9275-f9a8fc1d9d92 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:58:36 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-31568c39-6bf9-42c5-89a2-95745871cfae req-47bae5af-57ec-4132-9275-f9a8fc1d9d92 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:58:36 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-87e2531a-0d78-41bc-a340-5ea40e9900c7 req-b8dc4248-cc4a-4d2a-9137-5cb09d796a95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029796 Apr 17 10:58:36 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 296/879] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:58:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:58:36 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-31568c39-6bf9-42c5-89a2-95745871cfae req-47bae5af-57ec-4132-9275-f9a8fc1d9d92 service nova] Creating event network-vif-deleted:d4f89575-0631-4344-ac9f-dfb2211df9a0 for instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 on user Apr 17 10:58:36 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-31568c39-6bf9-42c5-89a2-95745871cfae req-47bae5af-57ec-4132-9275-f9a8fc1d9d92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033032 Apr 17 10:58:36 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 302/880] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:58:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:58:36 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-7e2e4682-fffb-4293-bbfb-776d0dad20ed tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4/action" status: 202 len: 0 microversion: 2.1 time: 1.029389 Apr 17 10:58:36 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 283/881] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 10:58:35 2023] POST /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4/action => generated 0 bytes in 1031 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:58:37 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:58:37 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:58:37 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-bd805264-3b8c-4662-b161-aca9d97e79b1 req-3da0f66b-9f0a-48a8-84a2-c189f061063b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb68ad13-6870-417f-8593-4d41724109f4", "tag": "e139dcf1-9c53-4c70-849f-1a8126e4d347"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:58:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:58:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:58:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:58:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:58:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:58:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:58:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-bd805264-3b8c-4662-b161-aca9d97e79b1 req-3da0f66b-9f0a-48a8-84a2-c189f061063b service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:58:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-bd805264-3b8c-4662-b161-aca9d97e79b1 req-3da0f66b-9f0a-48a8-84a2-c189f061063b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:58:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-bd805264-3b8c-4662-b161-aca9d97e79b1 req-3da0f66b-9f0a-48a8-84a2-c189f061063b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:58:37 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-bd805264-3b8c-4662-b161-aca9d97e79b1 req-3da0f66b-9f0a-48a8-84a2-c189f061063b service nova] Creating event network-changed:e139dcf1-9c53-4c70-849f-1a8126e4d347 for instance bb68ad13-6870-417f-8593-4d41724109f4 on user Apr 17 10:58:37 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-bd805264-3b8c-4662-b161-aca9d97e79b1 req-3da0f66b-9f0a-48a8-84a2-c189f061063b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031631 Apr 17 10:58:37 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 303/882] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:58:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:58:37 user devstack@n-api.service[72743]: DEBUG nova.objects.instance [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lazy-loading 'services' on Instance uuid bb68ad13-6870-417f-8593-4d41724109f4 {{(pid=72743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 10:58:37 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-1ee0878c-81c6-4521-ab0c-4953c1f6e5b1 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4/os-volume_attachments/8c5f7bbd-005e-4a88-be2b-ff4f1cb86433" status: 202 len: 0 microversion: 2.1 time: 0.190951 Apr 17 10:58:37 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 297/883] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Apr 17 10:58:37 2023] DELETE /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4/os-volume_attachments/8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 10:58:37 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-ecbba094-187e-4611-954e-5fe70d911b41 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:58:37 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-ecbba094-187e-4611-954e-5fe70d911b41 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:58:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ecbba094-187e-4611-954e-5fe70d911b41 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:58:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ecbba094-187e-4611-954e-5fe70d911b41 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:58:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ecbba094-187e-4611-954e-5fe70d911b41 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:58:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ecbba094-187e-4611-954e-5fe70d911b41 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:58:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ecbba094-187e-4611-954e-5fe70d911b41 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:58:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-ecbba094-187e-4611-954e-5fe70d911b41 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:58:37 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-ecbba094-187e-4611-954e-5fe70d911b41 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050802 Apr 17 10:58:37 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 284/884] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:58:37 2023] GET /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:58:38 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-8c7db2d3-4845-45d8-b725-822a0661cc9d req-94da3969-e184-433a-a30f-0f389ed84b5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb68ad13-6870-417f-8593-4d41724109f4", "tag": "e139dcf1-9c53-4c70-849f-1a8126e4d347"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:58:38 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-8c7db2d3-4845-45d8-b725-822a0661cc9d req-94da3969-e184-433a-a30f-0f389ed84b5c service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:58:38 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-8c7db2d3-4845-45d8-b725-822a0661cc9d req-94da3969-e184-433a-a30f-0f389ed84b5c service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:58:38 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-8c7db2d3-4845-45d8-b725-822a0661cc9d req-94da3969-e184-433a-a30f-0f389ed84b5c service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:58:38 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-8c7db2d3-4845-45d8-b725-822a0661cc9d req-94da3969-e184-433a-a30f-0f389ed84b5c service nova] Creating event network-changed:e139dcf1-9c53-4c70-849f-1a8126e4d347 for instance bb68ad13-6870-417f-8593-4d41724109f4 on user Apr 17 10:58:38 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-8c7db2d3-4845-45d8-b725-822a0661cc9d req-94da3969-e184-433a-a30f-0f389ed84b5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028323 Apr 17 10:58:38 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 304/885] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:58:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:58:40 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-3201b1f0-5b9e-404a-b539-a2ac0c8b4ab2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:58:40 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-3201b1f0-5b9e-404a-b539-a2ac0c8b4ab2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:58:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3201b1f0-5b9e-404a-b539-a2ac0c8b4ab2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:58:41 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3201b1f0-5b9e-404a-b539-a2ac0c8b4ab2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:58:41 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3201b1f0-5b9e-404a-b539-a2ac0c8b4ab2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:58:41 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3201b1f0-5b9e-404a-b539-a2ac0c8b4ab2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:58:41 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3201b1f0-5b9e-404a-b539-a2ac0c8b4ab2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:58:41 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3201b1f0-5b9e-404a-b539-a2ac0c8b4ab2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:58:41 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-3201b1f0-5b9e-404a-b539-a2ac0c8b4ab2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c15ce534a649ae8a971b33221e2500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747b7d3c6844772b0e6eed5299053ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:58:41 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-3201b1f0-5b9e-404a-b539-a2ac0c8b4ab2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/385a180f-e722-4826-a6e0-47608461e66e" status: 200 len: 1488 microversion: 2.1 time: 0.215408 Apr 17 10:58:41 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 298/886] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:58:40 2023] GET /compute/v2.1/servers/385a180f-e722-4826-a6e0-47608461e66e => generated 1488 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:58:58 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:58:58 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:58:58 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:58:58 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:58:58 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:58:58 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:58:58 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:58:58 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:58:58 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:58:58 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:58:58 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Going to try to terminate instance {{(pid=72744) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:58:58 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-51a8dc9f-a22f-4dd4-b061-2a9e97b2acbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 204 len: 0 microversion: 2.1 time: 0.121713 Apr 17 10:58:58 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 285/887] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:58:58 2023] DELETE /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:58:58 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-a36200a1-df40-42b2-a688-51ecd8b5aa66 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:58:58 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-a36200a1-df40-42b2-a688-51ecd8b5aa66 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:58:58 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=10 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:58:58 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=10 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:58:58 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a36200a1-df40-42b2-a688-51ecd8b5aa66 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:58:58 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a36200a1-df40-42b2-a688-51ecd8b5aa66 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:58:58 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a36200a1-df40-42b2-a688-51ecd8b5aa66 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:58:58 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a36200a1-df40-42b2-a688-51ecd8b5aa66 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:58:58 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a36200a1-df40-42b2-a688-51ecd8b5aa66 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:58:58 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a36200a1-df40-42b2-a688-51ecd8b5aa66 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:58:58 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-a36200a1-df40-42b2-a688-51ecd8b5aa66 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:58:58 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-a36200a1-df40-42b2-a688-51ecd8b5aa66 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 200 len: 1727 microversion: 2.1 time: 0.259947 Apr 17 10:58:58 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 305/888] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:58:58 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 1727 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:58:58 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-aa95017b-db33-4bcb-91f7-200995b0e272 req-69ba00da-e155-4416-956d-a5d09a6a58e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38", "name": "network-vif-unplugged", "status": "completed", "tag": "67386c8f-911d-4398-b449-42af25f6afe3"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:58:58 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=8 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:58:58 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:58:58 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-aa95017b-db33-4bcb-91f7-200995b0e272 req-69ba00da-e155-4416-956d-a5d09a6a58e3 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:58:58 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-aa95017b-db33-4bcb-91f7-200995b0e272 req-69ba00da-e155-4416-956d-a5d09a6a58e3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:58:58 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-aa95017b-db33-4bcb-91f7-200995b0e272 req-69ba00da-e155-4416-956d-a5d09a6a58e3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:58:58 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-aa95017b-db33-4bcb-91f7-200995b0e272 req-69ba00da-e155-4416-956d-a5d09a6a58e3 service nova] Creating event network-vif-unplugged:67386c8f-911d-4398-b449-42af25f6afe3 for instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 on user Apr 17 10:58:58 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-aa95017b-db33-4bcb-91f7-200995b0e272 req-69ba00da-e155-4416-956d-a5d09a6a58e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034223 Apr 17 10:58:58 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 299/889] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:58:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:59:00 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-f312aed8-8c24-4ba0-87dc-5c10a892d9ad req-66234dd5-9ecd-4ccd-9317-a65ff87d4938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38", "name": "network-vif-plugged", "status": "completed", "tag": "67386c8f-911d-4398-b449-42af25f6afe3"}, {"server_uuid": "2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38", "name": "network-vif-deleted", "tag": "67386c8f-911d-4398-b449-42af25f6afe3"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:59:00 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-f312aed8-8c24-4ba0-87dc-5c10a892d9ad req-66234dd5-9ecd-4ccd-9317-a65ff87d4938 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:00 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-f312aed8-8c24-4ba0-87dc-5c10a892d9ad req-66234dd5-9ecd-4ccd-9317-a65ff87d4938 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:00 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-f312aed8-8c24-4ba0-87dc-5c10a892d9ad req-66234dd5-9ecd-4ccd-9317-a65ff87d4938 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:00 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-f312aed8-8c24-4ba0-87dc-5c10a892d9ad req-66234dd5-9ecd-4ccd-9317-a65ff87d4938 service nova] Creating event network-vif-plugged:67386c8f-911d-4398-b449-42af25f6afe3 for instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 on user Apr 17 10:59:00 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-f312aed8-8c24-4ba0-87dc-5c10a892d9ad req-66234dd5-9ecd-4ccd-9317-a65ff87d4938 service nova] Creating event network-vif-deleted:67386c8f-911d-4398-b449-42af25f6afe3 for instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 on user Apr 17 10:59:00 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-f312aed8-8c24-4ba0-87dc-5c10a892d9ad req-66234dd5-9ecd-4ccd-9317-a65ff87d4938 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029162 Apr 17 10:59:00 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 286/890] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:59:00 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:59:24 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-ce7bfd99-668c-4d43-aaa7-12a6b3d9e8bf tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:59:24 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-ce7bfd99-668c-4d43-aaa7-12a6b3d9e8bf tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:59:24 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:59:24 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:59:24 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ce7bfd99-668c-4d43-aaa7-12a6b3d9e8bf tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:24 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ce7bfd99-668c-4d43-aaa7-12a6b3d9e8bf tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:24 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ce7bfd99-668c-4d43-aaa7-12a6b3d9e8bf tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:24 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ce7bfd99-668c-4d43-aaa7-12a6b3d9e8bf tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:24 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ce7bfd99-668c-4d43-aaa7-12a6b3d9e8bf tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:24 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ce7bfd99-668c-4d43-aaa7-12a6b3d9e8bf tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:24 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-ce7bfd99-668c-4d43-aaa7-12a6b3d9e8bf tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] HTTP exception thrown: Instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 could not be found. Apr 17 10:59:24 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-ce7bfd99-668c-4d43-aaa7-12a6b3d9e8bf tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Request method failure captured: Apr 17 10:59:24 user devstack@n-api.service[72745]: request: GET /compute/v2.1/servers/109ee5e0-8c02-43c2-9415-48bb0c8c3a06 HTTP/1.1 Apr 17 10:59:24 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:59:24 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:59:24 user devstack@n-api.service[72745]: Connection: close Apr 17 10:59:24 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 10:59:24 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:59:24 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:59:24 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:59:24 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:59:24 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSSCVaY1iKFmkIuE91AAZWbZr-St_d2GFFrNXSeGSoQiDrm-J9xeGchCURDcBT2f6OJKR7j1O2xqpvL6Q1v7RUTS6S0coDZzk4yo8dpwf8dH_RMLU-Nova4o6mAYcBGkp1ZyRONF4za9zTxaNNTE8dZP8s8iS--XIiCu-N56JXP7Shg Apr 17 10:59:24 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:59:24 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:59:24 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:59:24 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:59:24 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:59:24 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:59:24 user devstack@n-api.service[72745]: X-Project-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 10:59:24 user devstack@n-api.service[72745]: X-Project-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 10:59:24 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:59:24 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:59:24 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:59:24 user devstack@n-api.service[72745]: X-Tenant: tempest-TestVolumeBootPattern-1777404437 Apr 17 10:59:24 user devstack@n-api.service[72745]: X-Tenant-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 10:59:24 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 10:59:24 user devstack@n-api.service[72745]: X-User: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 10:59:24 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:59:24 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:59:24 user devstack@n-api.service[72745]: X-User-Id: 0e4ed1192974484bba2d4392f4d011c2 Apr 17 10:59:24 user devstack@n-api.service[72745]: X-User-Name: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 10:59:24 user devstack@n-api.service[72745]: method: > Apr 17 10:59:24 user devstack@n-api.service[72745]: exception: Instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 could not be found. Apr 17 10:59:24 user devstack@n-api.service[72745]: action_args: {'id': '109ee5e0-8c02-43c2-9415-48bb0c8c3a06'} Apr 17 10:59:24 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 could not be found. Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 could not be found. Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 could not be found. Apr 17 10:59:24 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:59:24 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-ce7bfd99-668c-4d43-aaa7-12a6b3d9e8bf tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Returning 404 to user: Instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:59:24 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-ce7bfd99-668c-4d43-aaa7-12a6b3d9e8bf tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/109ee5e0-8c02-43c2-9415-48bb0c8c3a06" status: 404 len: 111 microversion: 2.1 time: 0.039345 Apr 17 10:59:24 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 306/891] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:59:24 2023] GET /compute/v2.1/servers/109ee5e0-8c02-43c2-9415-48bb0c8c3a06 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:59:24 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:59:24 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:59:24 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-79f74c2e-378d-479e-8269-1e90d2853783 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:59:24 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-79f74c2e-378d-479e-8269-1e90d2853783 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:59:24 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-79f74c2e-378d-479e-8269-1e90d2853783 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:24 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-79f74c2e-378d-479e-8269-1e90d2853783 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:24 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-79f74c2e-378d-479e-8269-1e90d2853783 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:24 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-79f74c2e-378d-479e-8269-1e90d2853783 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:24 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-79f74c2e-378d-479e-8269-1e90d2853783 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:24 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-79f74c2e-378d-479e-8269-1e90d2853783 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:24 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-79f74c2e-378d-479e-8269-1e90d2853783 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] HTTP exception thrown: Instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 could not be found. Apr 17 10:59:24 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-79f74c2e-378d-479e-8269-1e90d2853783 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Request method failure captured: Apr 17 10:59:24 user devstack@n-api.service[72743]: request: DELETE /compute/v2.1/servers/c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 HTTP/1.1 Apr 17 10:59:24 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:59:24 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:59:24 user devstack@n-api.service[72743]: Connection: close Apr 17 10:59:24 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:59:24 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:59:24 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:59:24 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:59:24 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:59:24 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSSCVaY1iKFmkIuE91AAZWbZr-St_d2GFFrNXSeGSoQiDrm-J9xeGchCURDcBT2f6OJKR7j1O2xqpvL6Q1v7RUTS6S0coDZzk4yo8dpwf8dH_RMLU-Nova4o6mAYcBGkp1ZyRONF4za9zTxaNNTE8dZP8s8iS--XIiCu-N56JXP7Shg Apr 17 10:59:24 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:59:24 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:59:24 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:59:24 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:59:24 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:59:24 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:59:24 user devstack@n-api.service[72743]: X-Project-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 10:59:24 user devstack@n-api.service[72743]: X-Project-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 10:59:24 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:59:24 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:59:24 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:59:24 user devstack@n-api.service[72743]: X-Tenant: tempest-TestVolumeBootPattern-1777404437 Apr 17 10:59:24 user devstack@n-api.service[72743]: X-Tenant-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 10:59:24 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 10:59:24 user devstack@n-api.service[72743]: X-User: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 10:59:24 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:59:24 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:59:24 user devstack@n-api.service[72743]: X-User-Id: 0e4ed1192974484bba2d4392f4d011c2 Apr 17 10:59:24 user devstack@n-api.service[72743]: X-User-Name: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 10:59:24 user devstack@n-api.service[72743]: method: > Apr 17 10:59:24 user devstack@n-api.service[72743]: exception: Instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 could not be found. Apr 17 10:59:24 user devstack@n-api.service[72743]: action_args: {'id': 'c0be0db8-2b49-43f1-8f6f-0f3c2d73e647'} Apr 17 10:59:24 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 could not be found. Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 could not be found. Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 could not be found. Apr 17 10:59:24 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:59:24 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-79f74c2e-378d-479e-8269-1e90d2853783 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Returning 404 to user: Instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:59:24 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-79f74c2e-378d-479e-8269-1e90d2853783 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c0be0db8-2b49-43f1-8f6f-0f3c2d73e647" status: 404 len: 111 microversion: 2.1 time: 0.040822 Apr 17 10:59:24 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 300/892] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:59:24 2023] DELETE /compute/v2.1/servers/c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:59:24 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:59:24 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:59:24 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-2fe638aa-cc0c-48b0-aeb3-409eaf9ecc51 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:59:24 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-2fe638aa-cc0c-48b0-aeb3-409eaf9ecc51 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: c0be0db8-2b49-43f1-8f6f-0f3c2d73e647] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:59:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2fe638aa-cc0c-48b0-aeb3-409eaf9ecc51 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2fe638aa-cc0c-48b0-aeb3-409eaf9ecc51 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2fe638aa-cc0c-48b0-aeb3-409eaf9ecc51 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2fe638aa-cc0c-48b0-aeb3-409eaf9ecc51 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2fe638aa-cc0c-48b0-aeb3-409eaf9ecc51 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2fe638aa-cc0c-48b0-aeb3-409eaf9ecc51 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:24 user devstack@n-api.service[72744]: INFO nova.api.openstack.wsgi [None req-2fe638aa-cc0c-48b0-aeb3-409eaf9ecc51 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] HTTP exception thrown: Instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 could not be found. Apr 17 10:59:24 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-2fe638aa-cc0c-48b0-aeb3-409eaf9ecc51 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Request method failure captured: Apr 17 10:59:24 user devstack@n-api.service[72744]: request: GET /compute/v2.1/servers/c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 HTTP/1.1 Apr 17 10:59:24 user devstack@n-api.service[72744]: Accept: application/json Apr 17 10:59:24 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 10:59:24 user devstack@n-api.service[72744]: Connection: close Apr 17 10:59:24 user devstack@n-api.service[72744]: Content-Length: 0 Apr 17 10:59:24 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 10:59:24 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 10:59:24 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 10:59:24 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 10:59:24 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSSCVaY1iKFmkIuE91AAZWbZr-St_d2GFFrNXSeGSoQiDrm-J9xeGchCURDcBT2f6OJKR7j1O2xqpvL6Q1v7RUTS6S0coDZzk4yo8dpwf8dH_RMLU-Nova4o6mAYcBGkp1ZyRONF4za9zTxaNNTE8dZP8s8iS--XIiCu-N56JXP7Shg Apr 17 10:59:24 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 10:59:24 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 10:59:24 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 10:59:24 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 10:59:24 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 10:59:24 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 10:59:24 user devstack@n-api.service[72744]: X-Project-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 10:59:24 user devstack@n-api.service[72744]: X-Project-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 10:59:24 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 10:59:24 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 10:59:24 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:59:24 user devstack@n-api.service[72744]: X-Tenant: tempest-TestVolumeBootPattern-1777404437 Apr 17 10:59:24 user devstack@n-api.service[72744]: X-Tenant-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 10:59:24 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 10:59:24 user devstack@n-api.service[72744]: X-User: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 10:59:24 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 10:59:24 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 10:59:24 user devstack@n-api.service[72744]: X-User-Id: 0e4ed1192974484bba2d4392f4d011c2 Apr 17 10:59:24 user devstack@n-api.service[72744]: X-User-Name: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 10:59:24 user devstack@n-api.service[72744]: method: > Apr 17 10:59:24 user devstack@n-api.service[72744]: exception: Instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 could not be found. Apr 17 10:59:24 user devstack@n-api.service[72744]: action_args: {'id': 'c0be0db8-2b49-43f1-8f6f-0f3c2d73e647'} Apr 17 10:59:24 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 could not be found. Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 could not be found. Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 could not be found. Apr 17 10:59:24 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:59:24 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-2fe638aa-cc0c-48b0-aeb3-409eaf9ecc51 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Returning 404 to user: Instance c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 could not be found. {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:59:24 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-2fe638aa-cc0c-48b0-aeb3-409eaf9ecc51 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c0be0db8-2b49-43f1-8f6f-0f3c2d73e647" status: 404 len: 111 microversion: 2.1 time: 0.037129 Apr 17 10:59:24 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 287/893] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:59:24 2023] GET /compute/v2.1/servers/c0be0db8-2b49-43f1-8f6f-0f3c2d73e647 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:59:24 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-7dd85a86-303e-45e4-b586-5ea1ff64f6a6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:59:24 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-7dd85a86-303e-45e4-b586-5ea1ff64f6a6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:59:24 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7dd85a86-303e-45e4-b586-5ea1ff64f6a6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:24 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7dd85a86-303e-45e4-b586-5ea1ff64f6a6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:24 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7dd85a86-303e-45e4-b586-5ea1ff64f6a6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:24 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7dd85a86-303e-45e4-b586-5ea1ff64f6a6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:24 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7dd85a86-303e-45e4-b586-5ea1ff64f6a6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:24 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7dd85a86-303e-45e4-b586-5ea1ff64f6a6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:24 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-7dd85a86-303e-45e4-b586-5ea1ff64f6a6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] HTTP exception thrown: Instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 could not be found. Apr 17 10:59:25 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-7dd85a86-303e-45e4-b586-5ea1ff64f6a6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Request method failure captured: Apr 17 10:59:25 user devstack@n-api.service[72745]: request: DELETE /compute/v2.1/servers/109ee5e0-8c02-43c2-9415-48bb0c8c3a06 HTTP/1.1 Apr 17 10:59:25 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:59:25 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:59:25 user devstack@n-api.service[72745]: Connection: close Apr 17 10:59:25 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 10:59:25 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:59:25 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:59:25 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:59:25 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:59:25 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSSCVaY1iKFmkIuE91AAZWbZr-St_d2GFFrNXSeGSoQiDrm-J9xeGchCURDcBT2f6OJKR7j1O2xqpvL6Q1v7RUTS6S0coDZzk4yo8dpwf8dH_RMLU-Nova4o6mAYcBGkp1ZyRONF4za9zTxaNNTE8dZP8s8iS--XIiCu-N56JXP7Shg Apr 17 10:59:25 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:59:25 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:59:25 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:59:25 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:59:25 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:59:25 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:59:25 user devstack@n-api.service[72745]: X-Project-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 10:59:25 user devstack@n-api.service[72745]: X-Project-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 10:59:25 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:59:25 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:59:25 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:59:25 user devstack@n-api.service[72745]: X-Tenant: tempest-TestVolumeBootPattern-1777404437 Apr 17 10:59:25 user devstack@n-api.service[72745]: X-Tenant-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 10:59:25 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 10:59:25 user devstack@n-api.service[72745]: X-User: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 10:59:25 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:59:25 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:59:25 user devstack@n-api.service[72745]: X-User-Id: 0e4ed1192974484bba2d4392f4d011c2 Apr 17 10:59:25 user devstack@n-api.service[72745]: X-User-Name: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 10:59:25 user devstack@n-api.service[72745]: method: > Apr 17 10:59:25 user devstack@n-api.service[72745]: exception: Instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 could not be found. Apr 17 10:59:25 user devstack@n-api.service[72745]: action_args: {'id': '109ee5e0-8c02-43c2-9415-48bb0c8c3a06'} Apr 17 10:59:25 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 could not be found. Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 could not be found. Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 could not be found. Apr 17 10:59:25 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:59:25 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-7dd85a86-303e-45e4-b586-5ea1ff64f6a6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Returning 404 to user: Instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:59:25 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-7dd85a86-303e-45e4-b586-5ea1ff64f6a6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/109ee5e0-8c02-43c2-9415-48bb0c8c3a06" status: 404 len: 111 microversion: 2.1 time: 0.032459 Apr 17 10:59:25 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 307/894] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:59:24 2023] DELETE /compute/v2.1/servers/109ee5e0-8c02-43c2-9415-48bb0c8c3a06 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:59:25 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-a8932f17-30c4-41df-82d8-cae974ab5074 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:59:25 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-a8932f17-30c4-41df-82d8-cae974ab5074 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 109ee5e0-8c02-43c2-9415-48bb0c8c3a06] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:59:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a8932f17-30c4-41df-82d8-cae974ab5074 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a8932f17-30c4-41df-82d8-cae974ab5074 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a8932f17-30c4-41df-82d8-cae974ab5074 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a8932f17-30c4-41df-82d8-cae974ab5074 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a8932f17-30c4-41df-82d8-cae974ab5074 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-a8932f17-30c4-41df-82d8-cae974ab5074 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:25 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-a8932f17-30c4-41df-82d8-cae974ab5074 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] HTTP exception thrown: Instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 could not be found. Apr 17 10:59:25 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-a8932f17-30c4-41df-82d8-cae974ab5074 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Request method failure captured: Apr 17 10:59:25 user devstack@n-api.service[72743]: request: GET /compute/v2.1/servers/109ee5e0-8c02-43c2-9415-48bb0c8c3a06 HTTP/1.1 Apr 17 10:59:25 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:59:25 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:59:25 user devstack@n-api.service[72743]: Connection: close Apr 17 10:59:25 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:59:25 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:59:25 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:59:25 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:59:25 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:59:25 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSSCVaY1iKFmkIuE91AAZWbZr-St_d2GFFrNXSeGSoQiDrm-J9xeGchCURDcBT2f6OJKR7j1O2xqpvL6Q1v7RUTS6S0coDZzk4yo8dpwf8dH_RMLU-Nova4o6mAYcBGkp1ZyRONF4za9zTxaNNTE8dZP8s8iS--XIiCu-N56JXP7Shg Apr 17 10:59:25 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:59:25 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:59:25 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:59:25 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:59:25 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:59:25 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:59:25 user devstack@n-api.service[72743]: X-Project-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 10:59:25 user devstack@n-api.service[72743]: X-Project-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 10:59:25 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:59:25 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:59:25 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:59:25 user devstack@n-api.service[72743]: X-Tenant: tempest-TestVolumeBootPattern-1777404437 Apr 17 10:59:25 user devstack@n-api.service[72743]: X-Tenant-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 10:59:25 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 10:59:25 user devstack@n-api.service[72743]: X-User: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 10:59:25 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:59:25 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:59:25 user devstack@n-api.service[72743]: X-User-Id: 0e4ed1192974484bba2d4392f4d011c2 Apr 17 10:59:25 user devstack@n-api.service[72743]: X-User-Name: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 10:59:25 user devstack@n-api.service[72743]: method: > Apr 17 10:59:25 user devstack@n-api.service[72743]: exception: Instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 could not be found. Apr 17 10:59:25 user devstack@n-api.service[72743]: action_args: {'id': '109ee5e0-8c02-43c2-9415-48bb0c8c3a06'} Apr 17 10:59:25 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 could not be found. Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 could not be found. Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 could not be found. Apr 17 10:59:25 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:59:25 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-a8932f17-30c4-41df-82d8-cae974ab5074 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Returning 404 to user: Instance 109ee5e0-8c02-43c2-9415-48bb0c8c3a06 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:59:25 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-a8932f17-30c4-41df-82d8-cae974ab5074 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/109ee5e0-8c02-43c2-9415-48bb0c8c3a06" status: 404 len: 111 microversion: 2.1 time: 0.030904 Apr 17 10:59:25 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 301/895] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:59:25 2023] GET /compute/v2.1/servers/109ee5e0-8c02-43c2-9415-48bb0c8c3a06 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:59:25 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-9846bae9-89b2-4b10-85f6-98600dae92d2 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Action: 'create', calling method: .version_select at 0x7fc55a7cf400>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-44084031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECpUWk4dEXNZAWn3e8xmVoeSyq+7sYKiwZ61zdkMiI+T4CettjyEy9SS4UPHnBJ5jg3jR6Qd649RX/Q8gfo07QMkxOdMXdo8EKO+BkjCCO/Efx+TgTy+4FlX+Ft713P2A=="}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:59:25 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-9846bae9-89b2-4b10-85f6-98600dae92d2 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Getting quotas for project 4fc3b8e3925847d48b522206a8875d3f. Resources: {'key_pairs'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:59:25 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-9846bae9-89b2-4b10-85f6-98600dae92d2 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Getting quotas for user 0e4ed1192974484bba2d4392f4d011c2 and project 4fc3b8e3925847d48b522206a8875d3f. Resources: {'key_pairs'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:59:25 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-9846bae9-89b2-4b10-85f6-98600dae92d2 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.044484 Apr 17 10:59:25 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 288/896] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 10:59:25 2023] POST /compute/v2.1/os-keypairs => generated 398 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:59:27 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-ec5ab337-7830-4ad4-b61f-8184041a7e60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:59:27 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-ec5ab337-7830-4ad4-b61f-8184041a7e60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:59:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ec5ab337-7830-4ad4-b61f-8184041a7e60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ec5ab337-7830-4ad4-b61f-8184041a7e60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ec5ab337-7830-4ad4-b61f-8184041a7e60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ec5ab337-7830-4ad4-b61f-8184041a7e60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ec5ab337-7830-4ad4-b61f-8184041a7e60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:27 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ec5ab337-7830-4ad4-b61f-8184041a7e60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:28 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-ec5ab337-7830-4ad4-b61f-8184041a7e60 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.306358 Apr 17 10:59:28 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 308/897] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:59:27 2023] GET /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4/os-volume_attachments => generated 25 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 17 10:59:28 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-62d4b833-66af-44a1-a80e-d2b3e8bc667b tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:59:28 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-62d4b833-66af-44a1-a80e-d2b3e8bc667b tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:59:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-62d4b833-66af-44a1-a80e-d2b3e8bc667b tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-62d4b833-66af-44a1-a80e-d2b3e8bc667b tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-62d4b833-66af-44a1-a80e-d2b3e8bc667b tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-62d4b833-66af-44a1-a80e-d2b3e8bc667b tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-62d4b833-66af-44a1-a80e-d2b3e8bc667b tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-62d4b833-66af-44a1-a80e-d2b3e8bc667b tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:28 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-62d4b833-66af-44a1-a80e-d2b3e8bc667b tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] HTTP exception thrown: Instance bb68ad13-6870-417f-8593-4d41724109f4 is not attached to volume 8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 Apr 17 10:59:28 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-62d4b833-66af-44a1-a80e-d2b3e8bc667b tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Request method failure captured: Apr 17 10:59:28 user devstack@n-api.service[72743]: request: DELETE /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4/os-volume_attachments/8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 HTTP/1.1 Apr 17 10:59:28 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:59:28 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:59:28 user devstack@n-api.service[72743]: Connection: close Apr 17 10:59:28 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:59:28 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:59:28 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:59:28 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:59:28 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:59:28 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSP-BtSOnsyB6KCaTxrrgInwl952BD18h9y51bwpAjWCA4Hbw1ASyPBLVrH2legVLq48N7IHlYA6cu4Ku2IXDLWK2ZiMfyI2VKOhTFw2CQ0qtXeShRjPK1bZ0whL7jFPD2oxtfVkX2pocE_tUozBhIsfCRD5HOWhpbvxnT2lby50mMU Apr 17 10:59:28 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:59:28 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:59:28 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:59:28 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:59:28 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:59:28 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:59:28 user devstack@n-api.service[72743]: X-Project-Id: 455ea6870abe450ba413ffabf4d4097e Apr 17 10:59:28 user devstack@n-api.service[72743]: X-Project-Name: tempest-TestMinimumBasicScenario-1309632250 Apr 17 10:59:28 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:59:28 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:59:28 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/455ea6870abe450ba413ffabf4d4097e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/455ea6870abe450ba413ffabf4d4097e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/455ea6870abe450ba413ffabf4d4097e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:59:28 user devstack@n-api.service[72743]: X-Tenant: tempest-TestMinimumBasicScenario-1309632250 Apr 17 10:59:28 user devstack@n-api.service[72743]: X-Tenant-Id: 455ea6870abe450ba413ffabf4d4097e Apr 17 10:59:28 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1309632250 Apr 17 10:59:28 user devstack@n-api.service[72743]: X-User: tempest-TestMinimumBasicScenario-1309632250-project-member Apr 17 10:59:28 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:59:28 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:59:28 user devstack@n-api.service[72743]: X-User-Id: df693038f49145b9854ae18d246dde2f Apr 17 10:59:28 user devstack@n-api.service[72743]: X-User-Name: tempest-TestMinimumBasicScenario-1309632250-project-member Apr 17 10:59:28 user devstack@n-api.service[72743]: method: > Apr 17 10:59:28 user devstack@n-api.service[72743]: exception: Instance bb68ad13-6870-417f-8593-4d41724109f4 is not attached to volume 8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 Apr 17 10:59:28 user devstack@n-api.service[72743]: action_args: {'server_id': 'bb68ad13-6870-417f-8593-4d41724109f4', 'id': '8c5f7bbd-005e-4a88-be2b-ff4f1cb86433'} Apr 17 10:59:28 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8c5f7bbd-005e-4a88-be2b-ff4f1cb86433. Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb68ad13-6870-417f-8593-4d41724109f4 is not attached to volume 8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb68ad13-6870-417f-8593-4d41724109f4 is not attached to volume 8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 Apr 17 10:59:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:59:28 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-62d4b833-66af-44a1-a80e-d2b3e8bc667b tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Returning 404 to user: Instance bb68ad13-6870-417f-8593-4d41724109f4 is not attached to volume 8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:59:28 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-62d4b833-66af-44a1-a80e-d2b3e8bc667b tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4/os-volume_attachments/8c5f7bbd-005e-4a88-be2b-ff4f1cb86433" status: 404 len: 154 microversion: 2.1 time: 0.111312 Apr 17 10:59:28 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 302/898] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Apr 17 10:59:28 2023] DELETE /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4/os-volume_attachments/8c5f7bbd-005e-4a88-be2b-ff4f1cb86433 => generated 154 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:59:30 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1988112604", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-44084031", "security_groups": [{"name": "tempest-secgroup-smoke-1508463427"}], "block_device_mapping_v2": [{"uuid": "32fcecef-5fb8-4df1-9e05-f988030c838f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2fc1cd4-860e-4abd-8e33-e797799c466f"}]}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:59:30 user devstack@n-api.service[72744]: DEBUG nova.network.neutron [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] validate_networks() for [('b2fc1cd4-860e-4abd-8e33-e797799c466f', None, None, None, None, None)] {{(pid=72744) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:59:30 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flavor limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:59:30 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Image limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:59:30 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flavor pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:59:30 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Image pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:59:30 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:59:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:30 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Getting quotas for project 4fc3b8e3925847d48b522206a8875d3f. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:59:30 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Getting quotas for user 0e4ed1192974484bba2d4392f4d011c2 and project 4fc3b8e3925847d48b522206a8875d3f. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:59:30 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Going to run 1 instances... {{(pid=72744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:59:30 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='32fcecef-5fb8-4df1-9e05-f988030c838f',volume_size=None,volume_type=None)] {{(pid=72744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:59:31 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-7ec4e57a-768f-4f5b-86b9-2878e947e0ae tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.827806 Apr 17 10:59:31 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 289/899] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:59:30 2023] POST /compute/v2.1/servers => generated 404 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 10:59:31 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-77a0dc52-edf3-4701-9b9c-585ee8ef7121 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:59:31 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-77a0dc52-edf3-4701-9b9c-585ee8ef7121 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:59:31 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-77a0dc52-edf3-4701-9b9c-585ee8ef7121 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:59:31 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-77a0dc52-edf3-4701-9b9c-585ee8ef7121 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ce6b406-b4f0-4b35-8925-b0a06e637775" status: 200 len: 1088 microversion: 2.1 time: 0.070213 Apr 17 10:59:31 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 309/900] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:59:31 2023] GET /compute/v2.1/servers/5ce6b406-b4f0-4b35-8925-b0a06e637775 => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:59:31 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:59:31 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:59:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:31 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:31 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Going to try to terminate instance {{(pid=72743) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 10:59:31 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-c504f7ea-9742-4647-b513-9ae1778867ff tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4" status: 204 len: 0 microversion: 2.1 time: 0.116576 Apr 17 10:59:31 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 303/901] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 10:59:31 2023] DELETE /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 10:59:31 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-d0d70296-53b5-468b-bf85-14139004f9aa tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:59:31 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-d0d70296-53b5-468b-bf85-14139004f9aa tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:59:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d0d70296-53b5-468b-bf85-14139004f9aa tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d0d70296-53b5-468b-bf85-14139004f9aa tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d0d70296-53b5-468b-bf85-14139004f9aa tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d0d70296-53b5-468b-bf85-14139004f9aa tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d0d70296-53b5-468b-bf85-14139004f9aa tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:31 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d0d70296-53b5-468b-bf85-14139004f9aa tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:31 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-d0d70296-53b5-468b-bf85-14139004f9aa tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df693038f49145b9854ae18d246dde2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455ea6870abe450ba413ffabf4d4097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:59:31 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-d0d70296-53b5-468b-bf85-14139004f9aa tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4" status: 200 len: 1542 microversion: 2.1 time: 0.272916 Apr 17 10:59:31 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 290/902] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:59:31 2023] GET /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4 => generated 1542 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:59:31 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-a5c2f570-6b1d-4381-b4be-66c2634b4867 req-0cb820b0-a8f3-4a68-8e28-746b2ea6c578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb68ad13-6870-417f-8593-4d41724109f4", "name": "network-vif-unplugged", "status": "completed", "tag": "e139dcf1-9c53-4c70-849f-1a8126e4d347"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:59:31 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-a5c2f570-6b1d-4381-b4be-66c2634b4867 req-0cb820b0-a8f3-4a68-8e28-746b2ea6c578 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:31 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-a5c2f570-6b1d-4381-b4be-66c2634b4867 req-0cb820b0-a8f3-4a68-8e28-746b2ea6c578 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:31 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-a5c2f570-6b1d-4381-b4be-66c2634b4867 req-0cb820b0-a8f3-4a68-8e28-746b2ea6c578 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:31 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-a5c2f570-6b1d-4381-b4be-66c2634b4867 req-0cb820b0-a8f3-4a68-8e28-746b2ea6c578 service nova] Creating event network-vif-unplugged:e139dcf1-9c53-4c70-849f-1a8126e4d347 for instance bb68ad13-6870-417f-8593-4d41724109f4 on user Apr 17 10:59:31 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-a5c2f570-6b1d-4381-b4be-66c2634b4867 req-0cb820b0-a8f3-4a68-8e28-746b2ea6c578 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029701 Apr 17 10:59:31 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 310/903] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:59:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:59:33 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-c829d3d9-6f88-4742-b272-610735ff0857 req-ef05e913-8534-46a6-8dcb-437ea3f74cfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb68ad13-6870-417f-8593-4d41724109f4", "name": "network-vif-deleted", "tag": "e139dcf1-9c53-4c70-849f-1a8126e4d347"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:59:33 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-c829d3d9-6f88-4742-b272-610735ff0857 req-ef05e913-8534-46a6-8dcb-437ea3f74cfd service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:33 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-c829d3d9-6f88-4742-b272-610735ff0857 req-ef05e913-8534-46a6-8dcb-437ea3f74cfd service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:33 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-c829d3d9-6f88-4742-b272-610735ff0857 req-ef05e913-8534-46a6-8dcb-437ea3f74cfd service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:33 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-c829d3d9-6f88-4742-b272-610735ff0857 req-ef05e913-8534-46a6-8dcb-437ea3f74cfd service nova] Creating event network-vif-deleted:e139dcf1-9c53-4c70-849f-1a8126e4d347 for instance bb68ad13-6870-417f-8593-4d41724109f4 on user Apr 17 10:59:33 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-c829d3d9-6f88-4742-b272-610735ff0857 req-ef05e913-8534-46a6-8dcb-437ea3f74cfd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050143 Apr 17 10:59:33 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 304/904] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:59:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:59:33 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-76a7f5ed-135f-4e13-899d-2e8b968defd9 req-0e55fb09-4cd5-469b-9a8c-fdcbefae13e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb68ad13-6870-417f-8593-4d41724109f4", "name": "network-vif-plugged", "status": "completed", "tag": "e139dcf1-9c53-4c70-849f-1a8126e4d347"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:59:33 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-76a7f5ed-135f-4e13-899d-2e8b968defd9 req-0e55fb09-4cd5-469b-9a8c-fdcbefae13e3 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:33 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-76a7f5ed-135f-4e13-899d-2e8b968defd9 req-0e55fb09-4cd5-469b-9a8c-fdcbefae13e3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:33 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-76a7f5ed-135f-4e13-899d-2e8b968defd9 req-0e55fb09-4cd5-469b-9a8c-fdcbefae13e3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:33 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-76a7f5ed-135f-4e13-899d-2e8b968defd9 req-0e55fb09-4cd5-469b-9a8c-fdcbefae13e3 service nova] Creating event network-vif-plugged:e139dcf1-9c53-4c70-849f-1a8126e4d347 for instance bb68ad13-6870-417f-8593-4d41724109f4 on user Apr 17 10:59:33 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-76a7f5ed-135f-4e13-899d-2e8b968defd9 req-0e55fb09-4cd5-469b-9a8c-fdcbefae13e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029719 Apr 17 10:59:33 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 291/905] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:59:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:59:35 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-e4521e2f-f5d3-467f-8168-5016bc84371c req-a02a0307-3bfc-4901-82f8-75bc87fe5f64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ce6b406-b4f0-4b35-8925-b0a06e637775", "tag": "c6caf384-eff7-432e-a749-88e97ee14e4a"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:59:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-e4521e2f-f5d3-467f-8168-5016bc84371c req-a02a0307-3bfc-4901-82f8-75bc87fe5f64 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-e4521e2f-f5d3-467f-8168-5016bc84371c req-a02a0307-3bfc-4901-82f8-75bc87fe5f64 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-e4521e2f-f5d3-467f-8168-5016bc84371c req-a02a0307-3bfc-4901-82f8-75bc87fe5f64 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:35 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-e4521e2f-f5d3-467f-8168-5016bc84371c req-a02a0307-3bfc-4901-82f8-75bc87fe5f64 service nova] Creating event network-changed:c6caf384-eff7-432e-a749-88e97ee14e4a for instance 5ce6b406-b4f0-4b35-8925-b0a06e637775 on user Apr 17 10:59:35 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-e4521e2f-f5d3-467f-8168-5016bc84371c req-a02a0307-3bfc-4901-82f8-75bc87fe5f64 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033754 Apr 17 10:59:35 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 311/906] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:59:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:59:40 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-e7cf7698-616c-4cf9-a055-801a30fe557c req-a620f132-e2f1-4d61-b8a1-bc57ca611da4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ce6b406-b4f0-4b35-8925-b0a06e637775", "name": "network-vif-plugged", "status": "completed", "tag": "c6caf384-eff7-432e-a749-88e97ee14e4a"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:59:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-e7cf7698-616c-4cf9-a055-801a30fe557c req-a620f132-e2f1-4d61-b8a1-bc57ca611da4 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-e7cf7698-616c-4cf9-a055-801a30fe557c req-a620f132-e2f1-4d61-b8a1-bc57ca611da4 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-e7cf7698-616c-4cf9-a055-801a30fe557c req-a620f132-e2f1-4d61-b8a1-bc57ca611da4 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:40 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-e7cf7698-616c-4cf9-a055-801a30fe557c req-a620f132-e2f1-4d61-b8a1-bc57ca611da4 service nova] Creating event network-vif-plugged:c6caf384-eff7-432e-a749-88e97ee14e4a for instance 5ce6b406-b4f0-4b35-8925-b0a06e637775 on user Apr 17 10:59:40 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-e7cf7698-616c-4cf9-a055-801a30fe557c req-a620f132-e2f1-4d61-b8a1-bc57ca611da4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039628 Apr 17 10:59:40 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 305/907] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:59:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:59:41 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:59:41 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=10 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:59:41 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-7553696e-6661-48a2-a844-b928b4c97e47 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:59:41 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-7553696e-6661-48a2-a844-b928b4c97e47 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:59:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7553696e-6661-48a2-a844-b928b4c97e47 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7553696e-6661-48a2-a844-b928b4c97e47 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7553696e-6661-48a2-a844-b928b4c97e47 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7553696e-6661-48a2-a844-b928b4c97e47 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7553696e-6661-48a2-a844-b928b4c97e47 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-7553696e-6661-48a2-a844-b928b4c97e47 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:41 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-7553696e-6661-48a2-a844-b928b4c97e47 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c15ce534a649ae8a971b33221e2500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747b7d3c6844772b0e6eed5299053ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:59:41 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-7553696e-6661-48a2-a844-b928b4c97e47 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" status: 200 len: 1503 microversion: 2.1 time: 0.222959 Apr 17 10:59:41 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 292/908] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:59:41 2023] GET /compute/v2.1/servers/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f => generated 1503 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:59:42 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:59:42 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-f2cff8ef-6b1a-4a21-88cf-bd79422ccc9c req-9958ef7e-5f01-4e0b-88e7-aba08131d621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ce6b406-b4f0-4b35-8925-b0a06e637775", "name": "network-vif-plugged", "status": "completed", "tag": "c6caf384-eff7-432e-a749-88e97ee14e4a"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:59:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-f2cff8ef-6b1a-4a21-88cf-bd79422ccc9c req-9958ef7e-5f01-4e0b-88e7-aba08131d621 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-f2cff8ef-6b1a-4a21-88cf-bd79422ccc9c req-9958ef7e-5f01-4e0b-88e7-aba08131d621 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:42 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-f2cff8ef-6b1a-4a21-88cf-bd79422ccc9c req-9958ef7e-5f01-4e0b-88e7-aba08131d621 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:42 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-f2cff8ef-6b1a-4a21-88cf-bd79422ccc9c req-9958ef7e-5f01-4e0b-88e7-aba08131d621 service nova] Creating event network-vif-plugged:c6caf384-eff7-432e-a749-88e97ee14e4a for instance 5ce6b406-b4f0-4b35-8925-b0a06e637775 on user Apr 17 10:59:42 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-f2cff8ef-6b1a-4a21-88cf-bd79422ccc9c req-9958ef7e-5f01-4e0b-88e7-aba08131d621 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031955 Apr 17 10:59:42 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 312/909] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:59:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:59:48 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-8d752431-9647-437b-8b54-11c1cad9d0c1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:59:48 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-8d752431-9647-437b-8b54-11c1cad9d0c1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:59:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8d752431-9647-437b-8b54-11c1cad9d0c1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8d752431-9647-437b-8b54-11c1cad9d0c1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8d752431-9647-437b-8b54-11c1cad9d0c1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8d752431-9647-437b-8b54-11c1cad9d0c1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8d752431-9647-437b-8b54-11c1cad9d0c1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8d752431-9647-437b-8b54-11c1cad9d0c1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:48 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-8d752431-9647-437b-8b54-11c1cad9d0c1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] HTTP exception thrown: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. Apr 17 10:59:48 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-8d752431-9647-437b-8b54-11c1cad9d0c1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Request method failure captured: Apr 17 10:59:48 user devstack@n-api.service[72743]: request: GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 HTTP/1.1 Apr 17 10:59:48 user devstack@n-api.service[72743]: Accept: application/json Apr 17 10:59:48 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 10:59:48 user devstack@n-api.service[72743]: Connection: close Apr 17 10:59:48 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 10:59:48 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 10:59:48 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 10:59:48 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 10:59:48 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 10:59:48 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSNDDukOA8EPGS_JB9BsvtkI9C7IEIOZRqMnIfWkrLT4xoIZaX0pcEoI0m7n5QDjj9YhnvQl9_4zK2ppURuFVv3B8rHwHUMgGTge6_4n3i8OhDt-XaWKbcEY3OMG0sXTCZ5H1g2CzMX9wwItjKWNb07Gf-LHL2aAzmNlLTXBm-ti6e8 Apr 17 10:59:48 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 10:59:48 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 10:59:48 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 10:59:48 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 10:59:48 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 10:59:48 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 10:59:48 user devstack@n-api.service[72743]: X-Project-Id: cc1b39ff9581474b87c58164e5cafa00 Apr 17 10:59:48 user devstack@n-api.service[72743]: X-Project-Name: tempest-ServerActionsTestJSON-2107442540 Apr 17 10:59:48 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 10:59:48 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 10:59:48 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc1b39ff9581474b87c58164e5cafa00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc1b39ff9581474b87c58164e5cafa00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cc1b39ff9581474b87c58164e5cafa00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:59:48 user devstack@n-api.service[72743]: X-Tenant: tempest-ServerActionsTestJSON-2107442540 Apr 17 10:59:48 user devstack@n-api.service[72743]: X-Tenant-Id: cc1b39ff9581474b87c58164e5cafa00 Apr 17 10:59:48 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-ServerActionsTestJSON-2107442540 Apr 17 10:59:48 user devstack@n-api.service[72743]: X-User: tempest-ServerActionsTestJSON-2107442540-project-member Apr 17 10:59:48 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 10:59:48 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 10:59:48 user devstack@n-api.service[72743]: X-User-Id: a7e218d771db49e88d13d3b088f3d88a Apr 17 10:59:48 user devstack@n-api.service[72743]: X-User-Name: tempest-ServerActionsTestJSON-2107442540-project-member Apr 17 10:59:48 user devstack@n-api.service[72743]: method: > Apr 17 10:59:48 user devstack@n-api.service[72743]: exception: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. Apr 17 10:59:48 user devstack@n-api.service[72743]: action_args: {'id': '2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38'} Apr 17 10:59:48 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. Apr 17 10:59:48 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 10:59:48 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-8d752431-9647-437b-8b54-11c1cad9d0c1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Returning 404 to user: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:59:48 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-8d752431-9647-437b-8b54-11c1cad9d0c1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 404 len: 111 microversion: 2.1 time: 0.041666 Apr 17 10:59:48 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 306/910] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:59:48 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:59:48 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-669b521a-a9ea-4da6-b88c-5f4c81d15fc2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:59:48 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-669b521a-a9ea-4da6-b88c-5f4c81d15fc2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:59:48 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-669b521a-a9ea-4da6-b88c-5f4c81d15fc2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:48 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-669b521a-a9ea-4da6-b88c-5f4c81d15fc2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:48 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-669b521a-a9ea-4da6-b88c-5f4c81d15fc2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:48 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-669b521a-a9ea-4da6-b88c-5f4c81d15fc2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:48 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-669b521a-a9ea-4da6-b88c-5f4c81d15fc2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:48 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-669b521a-a9ea-4da6-b88c-5f4c81d15fc2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:48 user devstack@n-api.service[72744]: INFO nova.api.openstack.wsgi [None req-669b521a-a9ea-4da6-b88c-5f4c81d15fc2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] HTTP exception thrown: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. Apr 17 10:59:48 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-669b521a-a9ea-4da6-b88c-5f4c81d15fc2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Request method failure captured: Apr 17 10:59:48 user devstack@n-api.service[72744]: request: GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/os-volume_attachments HTTP/1.1 Apr 17 10:59:48 user devstack@n-api.service[72744]: Accept: application/json Apr 17 10:59:48 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 10:59:48 user devstack@n-api.service[72744]: Connection: close Apr 17 10:59:48 user devstack@n-api.service[72744]: Content-Length: 0 Apr 17 10:59:48 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 10:59:48 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 10:59:48 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 10:59:48 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 10:59:48 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSNDDukOA8EPGS_JB9BsvtkI9C7IEIOZRqMnIfWkrLT4xoIZaX0pcEoI0m7n5QDjj9YhnvQl9_4zK2ppURuFVv3B8rHwHUMgGTge6_4n3i8OhDt-XaWKbcEY3OMG0sXTCZ5H1g2CzMX9wwItjKWNb07Gf-LHL2aAzmNlLTXBm-ti6e8 Apr 17 10:59:48 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 10:59:48 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 10:59:48 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 10:59:48 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 10:59:48 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 10:59:48 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 10:59:48 user devstack@n-api.service[72744]: X-Project-Id: cc1b39ff9581474b87c58164e5cafa00 Apr 17 10:59:48 user devstack@n-api.service[72744]: X-Project-Name: tempest-ServerActionsTestJSON-2107442540 Apr 17 10:59:48 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 10:59:48 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 10:59:48 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc1b39ff9581474b87c58164e5cafa00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc1b39ff9581474b87c58164e5cafa00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cc1b39ff9581474b87c58164e5cafa00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:59:48 user devstack@n-api.service[72744]: X-Tenant: tempest-ServerActionsTestJSON-2107442540 Apr 17 10:59:48 user devstack@n-api.service[72744]: X-Tenant-Id: cc1b39ff9581474b87c58164e5cafa00 Apr 17 10:59:48 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-ServerActionsTestJSON-2107442540 Apr 17 10:59:48 user devstack@n-api.service[72744]: X-User: tempest-ServerActionsTestJSON-2107442540-project-member Apr 17 10:59:48 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 10:59:48 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 10:59:48 user devstack@n-api.service[72744]: X-User-Id: a7e218d771db49e88d13d3b088f3d88a Apr 17 10:59:48 user devstack@n-api.service[72744]: X-User-Name: tempest-ServerActionsTestJSON-2107442540-project-member Apr 17 10:59:48 user devstack@n-api.service[72744]: method: > Apr 17 10:59:48 user devstack@n-api.service[72744]: exception: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. Apr 17 10:59:48 user devstack@n-api.service[72744]: action_args: {'server_id': '2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38'} Apr 17 10:59:48 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. Apr 17 10:59:48 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 10:59:48 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-669b521a-a9ea-4da6-b88c-5f4c81d15fc2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Returning 404 to user: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:59:48 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-669b521a-a9ea-4da6-b88c-5f4c81d15fc2 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040635 Apr 17 10:59:48 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 293/911] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 10:59:48 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:59:48 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-1594a2b9-01dd-4d24-be3b-baba2a8f3839 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:59:48 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-1594a2b9-01dd-4d24-be3b-baba2a8f3839 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:59:48 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1594a2b9-01dd-4d24-be3b-baba2a8f3839 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:48 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1594a2b9-01dd-4d24-be3b-baba2a8f3839 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:48 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1594a2b9-01dd-4d24-be3b-baba2a8f3839 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:48 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1594a2b9-01dd-4d24-be3b-baba2a8f3839 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:48 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1594a2b9-01dd-4d24-be3b-baba2a8f3839 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:48 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1594a2b9-01dd-4d24-be3b-baba2a8f3839 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:48 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-1594a2b9-01dd-4d24-be3b-baba2a8f3839 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] HTTP exception thrown: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. Apr 17 10:59:48 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-1594a2b9-01dd-4d24-be3b-baba2a8f3839 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Request method failure captured: Apr 17 10:59:48 user devstack@n-api.service[72745]: request: GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 HTTP/1.1 Apr 17 10:59:48 user devstack@n-api.service[72745]: Accept: application/json Apr 17 10:59:48 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 10:59:48 user devstack@n-api.service[72745]: Connection: close Apr 17 10:59:48 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 10:59:48 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 10:59:48 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 10:59:48 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 10:59:48 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 10:59:48 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSNDDukOA8EPGS_JB9BsvtkI9C7IEIOZRqMnIfWkrLT4xoIZaX0pcEoI0m7n5QDjj9YhnvQl9_4zK2ppURuFVv3B8rHwHUMgGTge6_4n3i8OhDt-XaWKbcEY3OMG0sXTCZ5H1g2CzMX9wwItjKWNb07Gf-LHL2aAzmNlLTXBm-ti6e8 Apr 17 10:59:48 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 10:59:48 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 10:59:48 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 10:59:48 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 10:59:48 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 10:59:48 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 10:59:48 user devstack@n-api.service[72745]: X-Project-Id: cc1b39ff9581474b87c58164e5cafa00 Apr 17 10:59:48 user devstack@n-api.service[72745]: X-Project-Name: tempest-ServerActionsTestJSON-2107442540 Apr 17 10:59:48 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 10:59:48 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 10:59:48 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc1b39ff9581474b87c58164e5cafa00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc1b39ff9581474b87c58164e5cafa00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cc1b39ff9581474b87c58164e5cafa00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 10:59:48 user devstack@n-api.service[72745]: X-Tenant: tempest-ServerActionsTestJSON-2107442540 Apr 17 10:59:48 user devstack@n-api.service[72745]: X-Tenant-Id: cc1b39ff9581474b87c58164e5cafa00 Apr 17 10:59:48 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-ServerActionsTestJSON-2107442540 Apr 17 10:59:48 user devstack@n-api.service[72745]: X-User: tempest-ServerActionsTestJSON-2107442540-project-member Apr 17 10:59:48 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 10:59:48 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 10:59:48 user devstack@n-api.service[72745]: X-User-Id: a7e218d771db49e88d13d3b088f3d88a Apr 17 10:59:48 user devstack@n-api.service[72745]: X-User-Name: tempest-ServerActionsTestJSON-2107442540-project-member Apr 17 10:59:48 user devstack@n-api.service[72745]: method: > Apr 17 10:59:48 user devstack@n-api.service[72745]: exception: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. Apr 17 10:59:48 user devstack@n-api.service[72745]: action_args: {'id': '2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38'} Apr 17 10:59:48 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. Apr 17 10:59:48 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 10:59:48 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-1594a2b9-01dd-4d24-be3b-baba2a8f3839 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Returning 404 to user: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 10:59:48 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-1594a2b9-01dd-4d24-be3b-baba2a8f3839 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 404 len: 111 microversion: 2.1 time: 0.035823 Apr 17 10:59:48 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 313/912] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:59:48 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 10:59:49 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-455400217", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "networks": [{"uuid": "b6f8ce20-6af1-47a1-8b12-a5be609289ec"}], "security_groups": [{"name": "tempest-securitygroup--653924103"}], "key_name": "tempest-keypair-681910651", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:59:49 user devstack@n-api.service[72743]: DEBUG nova.network.neutron [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] validate_networks() for [('b6f8ce20-6af1-47a1-8b12-a5be609289ec', None, None, None, None, None)] {{(pid=72743) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 10:59:49 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flavor limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 10:59:49 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Image limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 10:59:49 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flavor pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 10:59:49 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Image pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 10:59:49 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 10:59:49 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:49 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:49 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:49 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:49 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:49 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:49 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting quotas for project cc1b39ff9581474b87c58164e5cafa00. Resources: {'cores', 'instances', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 10:59:49 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting quotas for user a7e218d771db49e88d13d3b088f3d88a and project cc1b39ff9581474b87c58164e5cafa00. Resources: {'cores', 'instances', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 10:59:49 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Going to run 1 instances... {{(pid=72743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 10:59:49 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 10:59:49 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-43bdef80-9c18-4011-b07e-9f8fc4573000 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.961719 Apr 17 10:59:49 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 307/913] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 10:59:49 2023] POST /compute/v2.1/servers => generated 403 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 10:59:49 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-bb4a6754-a723-4484-9524-37fa519f74b1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 10:59:49 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-bb4a6754-a723-4484-9524-37fa519f74b1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 10:59:50 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-bb4a6754-a723-4484-9524-37fa519f74b1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 10:59:50 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-bb4a6754-a723-4484-9524-37fa519f74b1 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3e25766f-ccf8-435e-9d56-1f371d52bbcf" status: 200 len: 1231 microversion: 2.1 time: 0.068651 Apr 17 10:59:50 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 294/914] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 10:59:49 2023] GET /compute/v2.1/servers/3e25766f-ccf8-435e-9d56-1f371d52bbcf => generated 1231 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 10:59:52 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-84d9e49e-11e6-43f3-b5c9-904eb8927bd5 req-47a8dcec-9440-42bf-84a5-6bcb326e1a25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e25766f-ccf8-435e-9d56-1f371d52bbcf", "tag": "50e629ae-2997-44f7-985a-9f0b73c8e576"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:59:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-84d9e49e-11e6-43f3-b5c9-904eb8927bd5 req-47a8dcec-9440-42bf-84a5-6bcb326e1a25 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-84d9e49e-11e6-43f3-b5c9-904eb8927bd5 req-47a8dcec-9440-42bf-84a5-6bcb326e1a25 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-84d9e49e-11e6-43f3-b5c9-904eb8927bd5 req-47a8dcec-9440-42bf-84a5-6bcb326e1a25 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:52 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-84d9e49e-11e6-43f3-b5c9-904eb8927bd5 req-47a8dcec-9440-42bf-84a5-6bcb326e1a25 service nova] Creating event network-changed:50e629ae-2997-44f7-985a-9f0b73c8e576 for instance 3e25766f-ccf8-435e-9d56-1f371d52bbcf on user Apr 17 10:59:52 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-84d9e49e-11e6-43f3-b5c9-904eb8927bd5 req-47a8dcec-9440-42bf-84a5-6bcb326e1a25 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037128 Apr 17 10:59:52 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 314/915] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:59:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:59:54 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-07ef855e-1e9d-45b9-93e7-9353dbdcc4c6 req-645c4fb1-fe5a-4139-9716-43212a42a94f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e25766f-ccf8-435e-9d56-1f371d52bbcf", "name": "network-vif-plugged", "status": "completed", "tag": "50e629ae-2997-44f7-985a-9f0b73c8e576"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:59:54 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-07ef855e-1e9d-45b9-93e7-9353dbdcc4c6 req-645c4fb1-fe5a-4139-9716-43212a42a94f service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:54 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-07ef855e-1e9d-45b9-93e7-9353dbdcc4c6 req-645c4fb1-fe5a-4139-9716-43212a42a94f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:54 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-07ef855e-1e9d-45b9-93e7-9353dbdcc4c6 req-645c4fb1-fe5a-4139-9716-43212a42a94f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:54 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-07ef855e-1e9d-45b9-93e7-9353dbdcc4c6 req-645c4fb1-fe5a-4139-9716-43212a42a94f service nova] Creating event network-vif-plugged:50e629ae-2997-44f7-985a-9f0b73c8e576 for instance 3e25766f-ccf8-435e-9d56-1f371d52bbcf on user Apr 17 10:59:54 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-07ef855e-1e9d-45b9-93e7-9353dbdcc4c6 req-645c4fb1-fe5a-4139-9716-43212a42a94f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030626 Apr 17 10:59:54 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 308/916] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:59:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 10:59:56 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-d83c8d36-c6e0-4a95-9526-cb12a861243f req-f7e10353-d07b-449a-a466-fcb883971842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e25766f-ccf8-435e-9d56-1f371d52bbcf", "name": "network-vif-plugged", "status": "completed", "tag": "50e629ae-2997-44f7-985a-9f0b73c8e576"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 10:59:56 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=4 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:59:56 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-d83c8d36-c6e0-4a95-9526-cb12a861243f req-f7e10353-d07b-449a-a466-fcb883971842 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 10:59:56 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-d83c8d36-c6e0-4a95-9526-cb12a861243f req-f7e10353-d07b-449a-a466-fcb883971842 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 10:59:56 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-d83c8d36-c6e0-4a95-9526-cb12a861243f req-f7e10353-d07b-449a-a466-fcb883971842 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 10:59:56 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=21 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 10:59:56 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-d83c8d36-c6e0-4a95-9526-cb12a861243f req-f7e10353-d07b-449a-a466-fcb883971842 service nova] Creating event network-vif-plugged:50e629ae-2997-44f7-985a-9f0b73c8e576 for instance 3e25766f-ccf8-435e-9d56-1f371d52bbcf on user Apr 17 10:59:56 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-d83c8d36-c6e0-4a95-9526-cb12a861243f req-f7e10353-d07b-449a-a466-fcb883971842 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032799 Apr 17 10:59:56 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 295/917] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 10:59:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:00:21 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=20 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:00:21 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=20 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:00:21 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-9f823582-4cee-40ca-908a-03237d5784f0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:00:21 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-9f823582-4cee-40ca-908a-03237d5784f0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:00:21 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9f823582-4cee-40ca-908a-03237d5784f0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:00:21 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9f823582-4cee-40ca-908a-03237d5784f0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:00:21 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9f823582-4cee-40ca-908a-03237d5784f0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:00:21 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9f823582-4cee-40ca-908a-03237d5784f0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:00:21 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9f823582-4cee-40ca-908a-03237d5784f0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:00:21 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9f823582-4cee-40ca-908a-03237d5784f0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:00:21 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-9f823582-4cee-40ca-908a-03237d5784f0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:00:21 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-9f823582-4cee-40ca-908a-03237d5784f0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ce6b406-b4f0-4b35-8925-b0a06e637775" status: 200 len: 1442 microversion: 2.1 time: 0.284734 Apr 17 11:00:21 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 315/918] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:00:21 2023] GET /compute/v2.1/servers/5ce6b406-b4f0-4b35-8925-b0a06e637775 => generated 1442 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:00:21 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:00:21 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:00:21 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:00:21 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:00:21 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-757e951a-4c43-4d00-aae0-e6f3a3a13229 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:00:21 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-757e951a-4c43-4d00-aae0-e6f3a3a13229 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] [instance: bb68ad13-6870-417f-8593-4d41724109f4] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:00:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-757e951a-4c43-4d00-aae0-e6f3a3a13229 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:00:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-757e951a-4c43-4d00-aae0-e6f3a3a13229 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:00:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-757e951a-4c43-4d00-aae0-e6f3a3a13229 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:00:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-757e951a-4c43-4d00-aae0-e6f3a3a13229 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:00:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-757e951a-4c43-4d00-aae0-e6f3a3a13229 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:00:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-757e951a-4c43-4d00-aae0-e6f3a3a13229 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:00:21 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-757e951a-4c43-4d00-aae0-e6f3a3a13229 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] HTTP exception thrown: Instance bb68ad13-6870-417f-8593-4d41724109f4 could not be found. Apr 17 11:00:21 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-757e951a-4c43-4d00-aae0-e6f3a3a13229 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Request method failure captured: Apr 17 11:00:21 user devstack@n-api.service[72743]: request: GET /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4 HTTP/1.1 Apr 17 11:00:21 user devstack@n-api.service[72743]: Accept: application/json Apr 17 11:00:21 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 11:00:21 user devstack@n-api.service[72743]: Connection: close Apr 17 11:00:21 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 11:00:21 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 11:00:21 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 11:00:21 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 11:00:21 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 11:00:21 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSP-BtSOnsyB6KCaTxrrgInwl952BD18h9y51bwpAjWCA4Hbw1ASyPBLVrH2legVLq48N7IHlYA6cu4Ku2IXDLWK2ZiMfyI2VKOhTFw2CQ0qtXeShRjPK1bZ0whL7jFPD2oxtfVkX2pocE_tUozBhIsfCRD5HOWhpbvxnT2lby50mMU Apr 17 11:00:21 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 11:00:21 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 11:00:21 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 11:00:21 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 11:00:21 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 11:00:21 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 11:00:21 user devstack@n-api.service[72743]: X-Project-Id: 455ea6870abe450ba413ffabf4d4097e Apr 17 11:00:21 user devstack@n-api.service[72743]: X-Project-Name: tempest-TestMinimumBasicScenario-1309632250 Apr 17 11:00:21 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 11:00:21 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 11:00:21 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/455ea6870abe450ba413ffabf4d4097e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/455ea6870abe450ba413ffabf4d4097e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/455ea6870abe450ba413ffabf4d4097e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:00:21 user devstack@n-api.service[72743]: X-Tenant: tempest-TestMinimumBasicScenario-1309632250 Apr 17 11:00:21 user devstack@n-api.service[72743]: X-Tenant-Id: 455ea6870abe450ba413ffabf4d4097e Apr 17 11:00:21 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1309632250 Apr 17 11:00:21 user devstack@n-api.service[72743]: X-User: tempest-TestMinimumBasicScenario-1309632250-project-member Apr 17 11:00:21 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 11:00:21 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 11:00:21 user devstack@n-api.service[72743]: X-User-Id: df693038f49145b9854ae18d246dde2f Apr 17 11:00:21 user devstack@n-api.service[72743]: X-User-Name: tempest-TestMinimumBasicScenario-1309632250-project-member Apr 17 11:00:21 user devstack@n-api.service[72743]: method: > Apr 17 11:00:21 user devstack@n-api.service[72743]: exception: Instance bb68ad13-6870-417f-8593-4d41724109f4 could not be found. Apr 17 11:00:21 user devstack@n-api.service[72743]: action_args: {'id': 'bb68ad13-6870-417f-8593-4d41724109f4'} Apr 17 11:00:21 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb68ad13-6870-417f-8593-4d41724109f4 could not be found. Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb68ad13-6870-417f-8593-4d41724109f4 could not be found. Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb68ad13-6870-417f-8593-4d41724109f4 could not be found. Apr 17 11:00:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:00:21 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-757e951a-4c43-4d00-aae0-e6f3a3a13229 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Returning 404 to user: Instance bb68ad13-6870-417f-8593-4d41724109f4 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:00:21 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-757e951a-4c43-4d00-aae0-e6f3a3a13229 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4" status: 404 len: 111 microversion: 2.1 time: 0.042813 Apr 17 11:00:21 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 309/919] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:00:21 2023] GET /compute/v2.1/servers/bb68ad13-6870-417f-8593-4d41724109f4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 11:00:21 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:00:21 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:00:21 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-c4151c0a-aed1-4872-8a19-f6fb57b8d3e9 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] Calling method '.version_select at 0x7fc55a7cdc60>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:00:21 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-c4151c0a-aed1-4872-8a19-f6fb57b8d3e9 tempest-TestMinimumBasicScenario-1309632250 tempest-TestMinimumBasicScenario-1309632250-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1990324644" status: 202 len: 0 microversion: 2.1 time: 0.028669 Apr 17 11:00:21 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 296/920] 10.0.0.210 () {62 vars in 1349 bytes} [Mon Apr 17 11:00:21 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1990324644 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 11:00:40 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-75196364-c514-4845-bcf2-f15b463edf48 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:00:40 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-75196364-c514-4845-bcf2-f15b463edf48 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:00:40 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:00:40 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:00:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-75196364-c514-4845-bcf2-f15b463edf48 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:00:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-75196364-c514-4845-bcf2-f15b463edf48 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:00:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-75196364-c514-4845-bcf2-f15b463edf48 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:00:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-75196364-c514-4845-bcf2-f15b463edf48 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:00:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-75196364-c514-4845-bcf2-f15b463edf48 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:00:40 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-75196364-c514-4845-bcf2-f15b463edf48 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:00:40 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-75196364-c514-4845-bcf2-f15b463edf48 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:00:40 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-75196364-c514-4845-bcf2-f15b463edf48 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3e25766f-ccf8-435e-9d56-1f371d52bbcf" status: 200 len: 1537 microversion: 2.1 time: 0.220202 Apr 17 11:00:40 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 316/921] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:00:40 2023] GET /compute/v2.1/servers/3e25766f-ccf8-435e-9d56-1f371d52bbcf => generated 1537 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:00:44 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:00:44 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:00:44 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:00:44 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:00:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:00:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:00:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:00:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:00:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:00:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:00:44 user devstack@n-api.service[72743]: DEBUG nova.objects.instance [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'flavor' on Instance uuid 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f {{(pid=72743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 11:00:44 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-9d75f9ec-1582-4204-8a27-4ac143e18222 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "POST /compute/v2.1/servers/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/action" status: 200 len: 32 microversion: 2.1 time: 0.111428 Apr 17 11:00:44 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 310/922] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 11:00:44 2023] POST /compute/v2.1/servers/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/action => generated 32 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 17 11:00:44 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:00:44 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-a8d648f0-3447-4092-b8fb-fce7b1e9d36d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:00:44 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-a8d648f0-3447-4092-b8fb-fce7b1e9d36d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:00:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a8d648f0-3447-4092-b8fb-fce7b1e9d36d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:00:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a8d648f0-3447-4092-b8fb-fce7b1e9d36d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:00:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a8d648f0-3447-4092-b8fb-fce7b1e9d36d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:00:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a8d648f0-3447-4092-b8fb-fce7b1e9d36d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:00:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a8d648f0-3447-4092-b8fb-fce7b1e9d36d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:00:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a8d648f0-3447-4092-b8fb-fce7b1e9d36d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:00:44 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-a8d648f0-3447-4092-b8fb-fce7b1e9d36d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c15ce534a649ae8a971b33221e2500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747b7d3c6844772b0e6eed5299053ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:00:44 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-a8d648f0-3447-4092-b8fb-fce7b1e9d36d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" status: 200 len: 1509 microversion: 2.1 time: 0.543454 Apr 17 11:00:44 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 297/923] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:00:44 2023] GET /compute/v2.1/servers/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f => generated 1509 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:00:45 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-123c88a3-ce25-43d7-bf58-02aa1614b572 req-eb8d9db1-692d-4109-aa06-c828c921898e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f", "name": "network-vif-unplugged", "status": "completed", "tag": "9c6c71a5-0190-4112-9044-5c238344dc88"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:00:45 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-123c88a3-ce25-43d7-bf58-02aa1614b572 req-eb8d9db1-692d-4109-aa06-c828c921898e service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:00:45 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-123c88a3-ce25-43d7-bf58-02aa1614b572 req-eb8d9db1-692d-4109-aa06-c828c921898e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:00:45 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-123c88a3-ce25-43d7-bf58-02aa1614b572 req-eb8d9db1-692d-4109-aa06-c828c921898e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:00:45 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-123c88a3-ce25-43d7-bf58-02aa1614b572 req-eb8d9db1-692d-4109-aa06-c828c921898e service nova] Creating event network-vif-unplugged:9c6c71a5-0190-4112-9044-5c238344dc88 for instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f on user Apr 17 11:00:45 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-123c88a3-ce25-43d7-bf58-02aa1614b572 req-eb8d9db1-692d-4109-aa06-c828c921898e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041047 Apr 17 11:00:45 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 317/924] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:00:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:00:47 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-666e181e-af23-46d7-96b2-a7417dac68e4 req-70e1acbf-6cb8-4886-aa51-eb152d10de7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f", "name": "network-vif-plugged", "status": "completed", "tag": "9c6c71a5-0190-4112-9044-5c238344dc88"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:00:47 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-666e181e-af23-46d7-96b2-a7417dac68e4 req-70e1acbf-6cb8-4886-aa51-eb152d10de7b service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:00:47 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-666e181e-af23-46d7-96b2-a7417dac68e4 req-70e1acbf-6cb8-4886-aa51-eb152d10de7b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:00:47 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-666e181e-af23-46d7-96b2-a7417dac68e4 req-70e1acbf-6cb8-4886-aa51-eb152d10de7b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:00:47 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-666e181e-af23-46d7-96b2-a7417dac68e4 req-70e1acbf-6cb8-4886-aa51-eb152d10de7b service nova] Creating event network-vif-plugged:9c6c71a5-0190-4112-9044-5c238344dc88 for instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f on user Apr 17 11:00:47 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-666e181e-af23-46d7-96b2-a7417dac68e4 req-70e1acbf-6cb8-4886-aa51-eb152d10de7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047654 Apr 17 11:00:47 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 311/925] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:00:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:00:49 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-469475e2-893c-4139-9a9b-b8cb87526b93 req-53e8d77b-c0ac-440c-aba6-841a562b21e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f", "name": "network-vif-plugged", "status": "completed", "tag": "9c6c71a5-0190-4112-9044-5c238344dc88"}, {"server_uuid": "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f", "name": "network-vif-plugged", "status": "completed", "tag": "9c6c71a5-0190-4112-9044-5c238344dc88"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:00:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-469475e2-893c-4139-9a9b-b8cb87526b93 req-53e8d77b-c0ac-440c-aba6-841a562b21e6 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:00:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-469475e2-893c-4139-9a9b-b8cb87526b93 req-53e8d77b-c0ac-440c-aba6-841a562b21e6 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:00:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-469475e2-893c-4139-9a9b-b8cb87526b93 req-53e8d77b-c0ac-440c-aba6-841a562b21e6 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:00:49 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-469475e2-893c-4139-9a9b-b8cb87526b93 req-53e8d77b-c0ac-440c-aba6-841a562b21e6 service nova] Creating event network-vif-plugged:9c6c71a5-0190-4112-9044-5c238344dc88 for instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f on user Apr 17 11:00:49 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-469475e2-893c-4139-9a9b-b8cb87526b93 req-53e8d77b-c0ac-440c-aba6-841a562b21e6 service nova] Creating event network-vif-plugged:9c6c71a5-0190-4112-9044-5c238344dc88 for instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f on user Apr 17 11:00:49 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-469475e2-893c-4139-9a9b-b8cb87526b93 req-53e8d77b-c0ac-440c-aba6-841a562b21e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040854 Apr 17 11:00:49 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 298/926] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:00:49 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:01:21 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=4 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:01:21 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=8 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:01:21 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-1a662b76-63a3-45a2-952a-ccfbce8ddb28 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:01:21 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-1a662b76-63a3-45a2-952a-ccfbce8ddb28 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:01:21 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1a662b76-63a3-45a2-952a-ccfbce8ddb28 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:01:21 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1a662b76-63a3-45a2-952a-ccfbce8ddb28 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:01:21 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1a662b76-63a3-45a2-952a-ccfbce8ddb28 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:01:21 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1a662b76-63a3-45a2-952a-ccfbce8ddb28 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:01:21 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1a662b76-63a3-45a2-952a-ccfbce8ddb28 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:01:21 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1a662b76-63a3-45a2-952a-ccfbce8ddb28 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:01:21 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-1a662b76-63a3-45a2-952a-ccfbce8ddb28 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:01:21 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-1a662b76-63a3-45a2-952a-ccfbce8ddb28 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ce6b406-b4f0-4b35-8925-b0a06e637775" status: 200 len: 1442 microversion: 2.1 time: 0.410023 Apr 17 11:01:21 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 318/927] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:01:21 2023] GET /compute/v2.1/servers/5ce6b406-b4f0-4b35-8925-b0a06e637775 => generated 1442 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:01:23 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=4 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:01:23 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:01:23 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-592d1cbd-aab3-436a-a661-03d52c5b285c req-f02a592e-c305-4407-b490-98a218dae615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ce6b406-b4f0-4b35-8925-b0a06e637775", "tag": "c6caf384-eff7-432e-a749-88e97ee14e4a"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:01:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-592d1cbd-aab3-436a-a661-03d52c5b285c req-f02a592e-c305-4407-b490-98a218dae615 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:01:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-592d1cbd-aab3-436a-a661-03d52c5b285c req-f02a592e-c305-4407-b490-98a218dae615 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:01:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-592d1cbd-aab3-436a-a661-03d52c5b285c req-f02a592e-c305-4407-b490-98a218dae615 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:01:23 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-592d1cbd-aab3-436a-a661-03d52c5b285c req-f02a592e-c305-4407-b490-98a218dae615 service nova] Creating event network-changed:c6caf384-eff7-432e-a749-88e97ee14e4a for instance 5ce6b406-b4f0-4b35-8925-b0a06e637775 on user Apr 17 11:01:23 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-592d1cbd-aab3-436a-a661-03d52c5b285c req-f02a592e-c305-4407-b490-98a218dae615 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040763 Apr 17 11:01:23 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 312/928] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:01:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:01:24 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=4 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:01:24 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=8 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:01:24 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:01:24 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:01:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:01:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:01:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:01:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:01:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:01:24 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:01:24 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Going to try to terminate instance {{(pid=72744) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 11:01:24 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-194aea01-6eeb-4783-b7ca-d9fd23836894 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5ce6b406-b4f0-4b35-8925-b0a06e637775" status: 204 len: 0 microversion: 2.1 time: 0.143919 Apr 17 11:01:24 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 299/929] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 11:01:24 2023] DELETE /compute/v2.1/servers/5ce6b406-b4f0-4b35-8925-b0a06e637775 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 11:01:24 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-b8d83abf-f5f2-4028-a61f-eeec6a8f01f6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:01:24 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-b8d83abf-f5f2-4028-a61f-eeec6a8f01f6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:01:24 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b8d83abf-f5f2-4028-a61f-eeec6a8f01f6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:01:24 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b8d83abf-f5f2-4028-a61f-eeec6a8f01f6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:01:24 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b8d83abf-f5f2-4028-a61f-eeec6a8f01f6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:01:24 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b8d83abf-f5f2-4028-a61f-eeec6a8f01f6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:01:24 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b8d83abf-f5f2-4028-a61f-eeec6a8f01f6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:01:24 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b8d83abf-f5f2-4028-a61f-eeec6a8f01f6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:01:24 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-b8d83abf-f5f2-4028-a61f-eeec6a8f01f6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:01:24 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-b8d83abf-f5f2-4028-a61f-eeec6a8f01f6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ce6b406-b4f0-4b35-8925-b0a06e637775" status: 200 len: 1448 microversion: 2.1 time: 0.198562 Apr 17 11:01:24 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 319/930] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:01:24 2023] GET /compute/v2.1/servers/5ce6b406-b4f0-4b35-8925-b0a06e637775 => generated 1448 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:01:25 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-24ef3adf-695f-4e24-9a6d-dd5b75521710 req-b1d96fc1-ab80-4697-a932-022845bb0ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ce6b406-b4f0-4b35-8925-b0a06e637775", "name": "network-vif-unplugged", "status": "completed", "tag": "c6caf384-eff7-432e-a749-88e97ee14e4a"}, {"server_uuid": "5ce6b406-b4f0-4b35-8925-b0a06e637775", "name": "network-vif-plugged", "status": "completed", "tag": "c6caf384-eff7-432e-a749-88e97ee14e4a"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:01:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-24ef3adf-695f-4e24-9a6d-dd5b75521710 req-b1d96fc1-ab80-4697-a932-022845bb0ab5 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:01:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-24ef3adf-695f-4e24-9a6d-dd5b75521710 req-b1d96fc1-ab80-4697-a932-022845bb0ab5 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:01:25 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-24ef3adf-695f-4e24-9a6d-dd5b75521710 req-b1d96fc1-ab80-4697-a932-022845bb0ab5 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:01:25 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-24ef3adf-695f-4e24-9a6d-dd5b75521710 req-b1d96fc1-ab80-4697-a932-022845bb0ab5 service nova] Creating event network-vif-unplugged:c6caf384-eff7-432e-a749-88e97ee14e4a for instance 5ce6b406-b4f0-4b35-8925-b0a06e637775 on user Apr 17 11:01:25 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-24ef3adf-695f-4e24-9a6d-dd5b75521710 req-b1d96fc1-ab80-4697-a932-022845bb0ab5 service nova] Creating event network-vif-plugged:c6caf384-eff7-432e-a749-88e97ee14e4a for instance 5ce6b406-b4f0-4b35-8925-b0a06e637775 on user Apr 17 11:01:25 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-24ef3adf-695f-4e24-9a6d-dd5b75521710 req-b1d96fc1-ab80-4697-a932-022845bb0ab5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.032403 Apr 17 11:01:25 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 313/931] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:01:25 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:01:26 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-62761dfb-9b41-4c1f-b3d7-f5f7d136ab16 req-c61ad364-87d7-4d38-9f12-7c0d003eae53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ce6b406-b4f0-4b35-8925-b0a06e637775", "name": "network-vif-deleted", "tag": "c6caf384-eff7-432e-a749-88e97ee14e4a"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:01:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-62761dfb-9b41-4c1f-b3d7-f5f7d136ab16 req-c61ad364-87d7-4d38-9f12-7c0d003eae53 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:01:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-62761dfb-9b41-4c1f-b3d7-f5f7d136ab16 req-c61ad364-87d7-4d38-9f12-7c0d003eae53 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:01:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-62761dfb-9b41-4c1f-b3d7-f5f7d136ab16 req-c61ad364-87d7-4d38-9f12-7c0d003eae53 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:01:26 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-62761dfb-9b41-4c1f-b3d7-f5f7d136ab16 req-c61ad364-87d7-4d38-9f12-7c0d003eae53 service nova] Creating event network-vif-deleted:c6caf384-eff7-432e-a749-88e97ee14e4a for instance 5ce6b406-b4f0-4b35-8925-b0a06e637775 on user Apr 17 11:01:26 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-62761dfb-9b41-4c1f-b3d7-f5f7d136ab16 req-c61ad364-87d7-4d38-9f12-7c0d003eae53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091927 Apr 17 11:01:26 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 300/932] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:01:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:01:34 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=4 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:01:34 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=12 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:01:34 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-ac4d24c9-a4c8-45e6-a464-77b03ed13432 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:01:34 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-ac4d24c9-a4c8-45e6-a464-77b03ed13432 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:01:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ac4d24c9-a4c8-45e6-a464-77b03ed13432 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:01:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ac4d24c9-a4c8-45e6-a464-77b03ed13432 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:01:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ac4d24c9-a4c8-45e6-a464-77b03ed13432 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:01:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ac4d24c9-a4c8-45e6-a464-77b03ed13432 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:01:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ac4d24c9-a4c8-45e6-a464-77b03ed13432 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:01:34 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ac4d24c9-a4c8-45e6-a464-77b03ed13432 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:01:35 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-ac4d24c9-a4c8-45e6-a464-77b03ed13432 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c15ce534a649ae8a971b33221e2500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747b7d3c6844772b0e6eed5299053ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:01:35 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-ac4d24c9-a4c8-45e6-a464-77b03ed13432 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" status: 200 len: 1489 microversion: 2.1 time: 0.362273 Apr 17 11:01:35 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 320/933] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:01:34 2023] GET /compute/v2.1/servers/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f => generated 1489 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:01:40 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=4 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:01:40 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=4 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:01:40 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-dd546bbd-d6f8-4e9c-a912-0f1f502f083c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:01:40 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-dd546bbd-d6f8-4e9c-a912-0f1f502f083c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:01:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-dd546bbd-d6f8-4e9c-a912-0f1f502f083c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:01:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-dd546bbd-d6f8-4e9c-a912-0f1f502f083c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:01:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-dd546bbd-d6f8-4e9c-a912-0f1f502f083c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:01:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-dd546bbd-d6f8-4e9c-a912-0f1f502f083c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:01:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-dd546bbd-d6f8-4e9c-a912-0f1f502f083c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:01:40 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-dd546bbd-d6f8-4e9c-a912-0f1f502f083c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:01:40 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-dd546bbd-d6f8-4e9c-a912-0f1f502f083c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3e25766f-ccf8-435e-9d56-1f371d52bbcf/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.389312 Apr 17 11:01:40 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 314/934] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 17 11:01:40 2023] GET /compute/v2.1/servers/3e25766f-ccf8-435e-9d56-1f371d52bbcf/os-interface => generated 282 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:01:41 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:01:41 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:01:41 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-902e0934-934b-4c19-afe6-41410702bfeb req-9356d289-8b20-4d89-948c-81e58a4b7b22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e25766f-ccf8-435e-9d56-1f371d52bbcf", "tag": "50e629ae-2997-44f7-985a-9f0b73c8e576"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:01:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-902e0934-934b-4c19-afe6-41410702bfeb req-9356d289-8b20-4d89-948c-81e58a4b7b22 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:01:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-902e0934-934b-4c19-afe6-41410702bfeb req-9356d289-8b20-4d89-948c-81e58a4b7b22 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:01:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-902e0934-934b-4c19-afe6-41410702bfeb req-9356d289-8b20-4d89-948c-81e58a4b7b22 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:01:41 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-902e0934-934b-4c19-afe6-41410702bfeb req-9356d289-8b20-4d89-948c-81e58a4b7b22 service nova] Creating event network-changed:50e629ae-2997-44f7-985a-9f0b73c8e576 for instance 3e25766f-ccf8-435e-9d56-1f371d52bbcf on user Apr 17 11:01:41 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-902e0934-934b-4c19-afe6-41410702bfeb req-9356d289-8b20-4d89-948c-81e58a4b7b22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040686 Apr 17 11:01:41 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 301/935] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:01:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:01:45 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1546798760", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "b6f8ce20-6af1-47a1-8b12-a5be609289ec"}], "security_groups": [{"name": "tempest-securitygroup--653924103"}], "key_name": "tempest-keypair-681910651", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "dde2742a-8a42-448e-bb75-17865e262b98", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:01:45 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:01:45 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:01:45 user devstack@n-api.service[72745]: DEBUG nova.network.neutron [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] validate_networks() for [('b6f8ce20-6af1-47a1-8b12-a5be609289ec', None, None, None, None, None)] {{(pid=72745) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 11:01:46 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flavor limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 11:01:46 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Image limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 11:01:46 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flavor pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 11:01:46 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Image pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 11:01:46 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 11:01:46 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:01:46 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:01:46 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:01:46 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:01:46 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:01:46 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:01:46 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting quotas for project cc1b39ff9581474b87c58164e5cafa00. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 11:01:46 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting quotas for user a7e218d771db49e88d13d3b088f3d88a and project cc1b39ff9581474b87c58164e5cafa00. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 11:01:46 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Going to run 1 instances... {{(pid=72745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 11:01:46 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dde2742a-8a42-448e-bb75-17865e262b98',volume_size=None,volume_type=None)] {{(pid=72745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 11:01:46 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-16967973-eac9-4b29-b7de-ef358d3bfd6c tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.894174 Apr 17 11:01:46 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 321/936] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 11:01:45 2023] POST /compute/v2.1/servers => generated 403 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 11:01:46 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-621858ae-9ec6-423d-8bf0-37fd53b57829 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:01:46 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-621858ae-9ec6-423d-8bf0-37fd53b57829 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:01:46 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-621858ae-9ec6-423d-8bf0-37fd53b57829 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:01:46 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-621858ae-9ec6-423d-8bf0-37fd53b57829 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" status: 200 len: 1075 microversion: 2.1 time: 0.067781 Apr 17 11:01:46 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 315/937] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:01:46 2023] GET /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e => generated 1075 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:01:49 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-37816398-018e-4df3-8aa2-93ab4c802cc2 req-18bca8ae-ad65-4f26-bd62-68304b99427a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e", "tag": "2ddba1ca-b737-4b90-9348-3f302831a57f"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:01:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-37816398-018e-4df3-8aa2-93ab4c802cc2 req-18bca8ae-ad65-4f26-bd62-68304b99427a service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:01:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-37816398-018e-4df3-8aa2-93ab4c802cc2 req-18bca8ae-ad65-4f26-bd62-68304b99427a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:01:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-37816398-018e-4df3-8aa2-93ab4c802cc2 req-18bca8ae-ad65-4f26-bd62-68304b99427a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:01:49 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-37816398-018e-4df3-8aa2-93ab4c802cc2 req-18bca8ae-ad65-4f26-bd62-68304b99427a service nova] Creating event network-changed:2ddba1ca-b737-4b90-9348-3f302831a57f for instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e on user Apr 17 11:01:49 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-37816398-018e-4df3-8aa2-93ab4c802cc2 req-18bca8ae-ad65-4f26-bd62-68304b99427a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033304 Apr 17 11:01:49 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 302/938] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:01:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:01:55 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-54ce8291-2aff-483a-9685-3dc54db3a84d req-1fe87957-13ab-43e7-84f9-41d421a38276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e", "name": "network-vif-plugged", "status": "completed", "tag": "2ddba1ca-b737-4b90-9348-3f302831a57f"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:01:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-54ce8291-2aff-483a-9685-3dc54db3a84d req-1fe87957-13ab-43e7-84f9-41d421a38276 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:01:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-54ce8291-2aff-483a-9685-3dc54db3a84d req-1fe87957-13ab-43e7-84f9-41d421a38276 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:01:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-54ce8291-2aff-483a-9685-3dc54db3a84d req-1fe87957-13ab-43e7-84f9-41d421a38276 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:01:55 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-54ce8291-2aff-483a-9685-3dc54db3a84d req-1fe87957-13ab-43e7-84f9-41d421a38276 service nova] Creating event network-vif-plugged:2ddba1ca-b737-4b90-9348-3f302831a57f for instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e on user Apr 17 11:01:55 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-54ce8291-2aff-483a-9685-3dc54db3a84d req-1fe87957-13ab-43e7-84f9-41d421a38276 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048298 Apr 17 11:01:55 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 322/939] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:01:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:01:57 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-03bc5aad-69e0-4fd7-bcce-4f415ccbefab req-78782634-9d45-49e2-8b51-1e7ec16d6174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e", "name": "network-vif-plugged", "status": "completed", "tag": "2ddba1ca-b737-4b90-9348-3f302831a57f"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:01:57 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=4 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:01:57 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:01:57 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:01:57 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-03bc5aad-69e0-4fd7-bcce-4f415ccbefab req-78782634-9d45-49e2-8b51-1e7ec16d6174 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:01:57 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-03bc5aad-69e0-4fd7-bcce-4f415ccbefab req-78782634-9d45-49e2-8b51-1e7ec16d6174 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:01:57 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-03bc5aad-69e0-4fd7-bcce-4f415ccbefab req-78782634-9d45-49e2-8b51-1e7ec16d6174 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:01:57 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-03bc5aad-69e0-4fd7-bcce-4f415ccbefab req-78782634-9d45-49e2-8b51-1e7ec16d6174 service nova] Creating event network-vif-plugged:2ddba1ca-b737-4b90-9348-3f302831a57f for instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e on user Apr 17 11:01:57 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-03bc5aad-69e0-4fd7-bcce-4f415ccbefab req-78782634-9d45-49e2-8b51-1e7ec16d6174 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037438 Apr 17 11:01:57 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 316/940] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:01:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:02:14 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=4 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:02:14 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=4 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:02:14 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-e6ce5915-77e7-44e6-8a30-881c92b9ba80 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:02:14 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-e6ce5915-77e7-44e6-8a30-881c92b9ba80 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:02:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e6ce5915-77e7-44e6-8a30-881c92b9ba80 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:02:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e6ce5915-77e7-44e6-8a30-881c92b9ba80 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:02:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e6ce5915-77e7-44e6-8a30-881c92b9ba80 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:02:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e6ce5915-77e7-44e6-8a30-881c92b9ba80 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:02:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e6ce5915-77e7-44e6-8a30-881c92b9ba80 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:02:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e6ce5915-77e7-44e6-8a30-881c92b9ba80 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:02:14 user devstack@n-api.service[72744]: INFO nova.api.openstack.wsgi [None req-e6ce5915-77e7-44e6-8a30-881c92b9ba80 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] HTTP exception thrown: Instance 5ce6b406-b4f0-4b35-8925-b0a06e637775 could not be found. Apr 17 11:02:14 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-e6ce5915-77e7-44e6-8a30-881c92b9ba80 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Request method failure captured: Apr 17 11:02:14 user devstack@n-api.service[72744]: request: GET /compute/v2.1/servers/5ce6b406-b4f0-4b35-8925-b0a06e637775 HTTP/1.1 Apr 17 11:02:14 user devstack@n-api.service[72744]: Accept: application/json Apr 17 11:02:14 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 11:02:14 user devstack@n-api.service[72744]: Connection: close Apr 17 11:02:14 user devstack@n-api.service[72744]: Content-Length: 0 Apr 17 11:02:14 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 11:02:14 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 11:02:14 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 11:02:14 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 11:02:14 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSSCVaY1iKFmkIuE91AAZWbZr-St_d2GFFrNXSeGSoQiDrm-J9xeGchCURDcBT2f6OJKR7j1O2xqpvL6Q1v7RUTS6S0coDZzk4yo8dpwf8dH_RMLU-Nova4o6mAYcBGkp1ZyRONF4za9zTxaNNTE8dZP8s8iS--XIiCu-N56JXP7Shg Apr 17 11:02:14 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 11:02:14 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 11:02:14 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 11:02:14 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 11:02:14 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 11:02:14 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 11:02:14 user devstack@n-api.service[72744]: X-Project-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 11:02:14 user devstack@n-api.service[72744]: X-Project-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 11:02:14 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 11:02:14 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 11:02:14 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:02:14 user devstack@n-api.service[72744]: X-Tenant: tempest-TestVolumeBootPattern-1777404437 Apr 17 11:02:14 user devstack@n-api.service[72744]: X-Tenant-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 11:02:14 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 11:02:14 user devstack@n-api.service[72744]: X-User: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 11:02:14 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 11:02:14 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 11:02:14 user devstack@n-api.service[72744]: X-User-Id: 0e4ed1192974484bba2d4392f4d011c2 Apr 17 11:02:14 user devstack@n-api.service[72744]: X-User-Name: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 11:02:14 user devstack@n-api.service[72744]: method: > Apr 17 11:02:14 user devstack@n-api.service[72744]: exception: Instance 5ce6b406-b4f0-4b35-8925-b0a06e637775 could not be found. Apr 17 11:02:14 user devstack@n-api.service[72744]: action_args: {'id': '5ce6b406-b4f0-4b35-8925-b0a06e637775'} Apr 17 11:02:14 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ce6b406-b4f0-4b35-8925-b0a06e637775 could not be found. Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ce6b406-b4f0-4b35-8925-b0a06e637775 could not be found. Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ce6b406-b4f0-4b35-8925-b0a06e637775 could not be found. Apr 17 11:02:14 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:02:14 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-e6ce5915-77e7-44e6-8a30-881c92b9ba80 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Returning 404 to user: Instance 5ce6b406-b4f0-4b35-8925-b0a06e637775 could not be found. {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:02:14 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-e6ce5915-77e7-44e6-8a30-881c92b9ba80 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ce6b406-b4f0-4b35-8925-b0a06e637775" status: 404 len: 111 microversion: 2.1 time: 0.035468 Apr 17 11:02:14 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 303/941] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:02:14 2023] GET /compute/v2.1/servers/5ce6b406-b4f0-4b35-8925-b0a06e637775 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 11:02:14 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:02:14 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:02:14 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:02:14 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=4 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:02:14 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-605051611", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-44084031", "security_groups": [{"name": "tempest-secgroup-smoke-1508463427"}], "block_device_mapping_v2": [{"uuid": "32fcecef-5fb8-4df1-9e05-f988030c838f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2fc1cd4-860e-4abd-8e33-e797799c466f"}]}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:02:14 user devstack@n-api.service[72745]: DEBUG nova.network.neutron [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] validate_networks() for [('b2fc1cd4-860e-4abd-8e33-e797799c466f', None, None, None, None, None)] {{(pid=72745) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 11:02:15 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flavor limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 11:02:15 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Image limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 11:02:15 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flavor pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 11:02:15 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Image pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 11:02:15 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 11:02:15 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:02:15 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:02:15 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:02:15 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:02:15 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:02:15 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:02:15 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Getting quotas for project 4fc3b8e3925847d48b522206a8875d3f. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 11:02:15 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Getting quotas for user 0e4ed1192974484bba2d4392f4d011c2 and project 4fc3b8e3925847d48b522206a8875d3f. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 11:02:15 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Going to run 1 instances... {{(pid=72745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 11:02:15 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='32fcecef-5fb8-4df1-9e05-f988030c838f',volume_size=None,volume_type=None)] {{(pid=72745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 11:02:15 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-9a505923-e389-4564-8822-552d47e6b093 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.741495 Apr 17 11:02:15 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 323/942] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 11:02:14 2023] POST /compute/v2.1/servers => generated 404 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 11:02:15 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-c90d0044-d714-472a-b31d-eb18bbc15108 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:02:15 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-c90d0044-d714-472a-b31d-eb18bbc15108 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:02:15 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:02:15 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:02:15 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-c90d0044-d714-472a-b31d-eb18bbc15108 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:02:15 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-c90d0044-d714-472a-b31d-eb18bbc15108 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/602fd731-58b4-42fc-abe5-8428f7ff0d1d" status: 200 len: 1087 microversion: 2.1 time: 0.075231 Apr 17 11:02:15 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 317/943] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:02:15 2023] GET /compute/v2.1/servers/602fd731-58b4-42fc-abe5-8428f7ff0d1d => generated 1087 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:02:17 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-7b2294a9-4ea7-4271-a0ef-464505a77186 req-4992cfee-b3eb-4cd6-97f8-9950d1354d0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "602fd731-58b4-42fc-abe5-8428f7ff0d1d", "tag": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:02:17 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-7b2294a9-4ea7-4271-a0ef-464505a77186 req-4992cfee-b3eb-4cd6-97f8-9950d1354d0a service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:02:17 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-7b2294a9-4ea7-4271-a0ef-464505a77186 req-4992cfee-b3eb-4cd6-97f8-9950d1354d0a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:02:17 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-7b2294a9-4ea7-4271-a0ef-464505a77186 req-4992cfee-b3eb-4cd6-97f8-9950d1354d0a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:02:17 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-7b2294a9-4ea7-4271-a0ef-464505a77186 req-4992cfee-b3eb-4cd6-97f8-9950d1354d0a service nova] Creating event network-changed:1ec35855-d3ca-49fe-8ea3-a810145ee9c8 for instance 602fd731-58b4-42fc-abe5-8428f7ff0d1d on user Apr 17 11:02:17 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-7b2294a9-4ea7-4271-a0ef-464505a77186 req-4992cfee-b3eb-4cd6-97f8-9950d1354d0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041390 Apr 17 11:02:17 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 304/944] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:02:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 11:02:24 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-e1e141e6-9c80-4189-9262-9e8ec2682be2 req-47d121d6-253d-40e9-954f-3009807bc87d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "602fd731-58b4-42fc-abe5-8428f7ff0d1d", "name": "network-vif-plugged", "status": "completed", "tag": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:02:24 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-e1e141e6-9c80-4189-9262-9e8ec2682be2 req-47d121d6-253d-40e9-954f-3009807bc87d service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:02:24 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-e1e141e6-9c80-4189-9262-9e8ec2682be2 req-47d121d6-253d-40e9-954f-3009807bc87d service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:02:24 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-e1e141e6-9c80-4189-9262-9e8ec2682be2 req-47d121d6-253d-40e9-954f-3009807bc87d service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:02:24 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-e1e141e6-9c80-4189-9262-9e8ec2682be2 req-47d121d6-253d-40e9-954f-3009807bc87d service nova] Creating event network-vif-plugged:1ec35855-d3ca-49fe-8ea3-a810145ee9c8 for instance 602fd731-58b4-42fc-abe5-8428f7ff0d1d on user Apr 17 11:02:24 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-e1e141e6-9c80-4189-9262-9e8ec2682be2 req-47d121d6-253d-40e9-954f-3009807bc87d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045955 Apr 17 11:02:24 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 324/945] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:02:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 11:02:26 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-96db3bf4-e159-46d4-aeb7-dd2e680a7115 req-4a78403d-0c57-4ff6-a171-35a704aee5e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "602fd731-58b4-42fc-abe5-8428f7ff0d1d", "name": "network-vif-plugged", "status": "completed", "tag": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:02:26 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=4 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:02:26 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:02:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-96db3bf4-e159-46d4-aeb7-dd2e680a7115 req-4a78403d-0c57-4ff6-a171-35a704aee5e5 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:02:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-96db3bf4-e159-46d4-aeb7-dd2e680a7115 req-4a78403d-0c57-4ff6-a171-35a704aee5e5 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:02:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-96db3bf4-e159-46d4-aeb7-dd2e680a7115 req-4a78403d-0c57-4ff6-a171-35a704aee5e5 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:02:26 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-96db3bf4-e159-46d4-aeb7-dd2e680a7115 req-4a78403d-0c57-4ff6-a171-35a704aee5e5 service nova] Creating event network-vif-plugged:1ec35855-d3ca-49fe-8ea3-a810145ee9c8 for instance 602fd731-58b4-42fc-abe5-8428f7ff0d1d on user Apr 17 11:02:26 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-96db3bf4-e159-46d4-aeb7-dd2e680a7115 req-4a78403d-0c57-4ff6-a171-35a704aee5e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035975 Apr 17 11:02:26 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 318/946] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:02:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:02:35 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=4 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:02:35 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=4 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:02:35 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-13c8862f-3b2a-4620-8cac-ecae347b7553 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "256ac907-1109-466b-a421-dc0a4b4f6266"}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:02:35 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-13c8862f-3b2a-4620-8cac-ecae347b7553 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:02:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-13c8862f-3b2a-4620-8cac-ecae347b7553 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:02:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-13c8862f-3b2a-4620-8cac-ecae347b7553 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:02:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-13c8862f-3b2a-4620-8cac-ecae347b7553 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:02:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-13c8862f-3b2a-4620-8cac-ecae347b7553 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:02:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-13c8862f-3b2a-4620-8cac-ecae347b7553 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:02:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-13c8862f-3b2a-4620-8cac-ecae347b7553 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:02:35 user devstack@n-api.service[72744]: INFO nova.api.openstack.wsgi [None req-13c8862f-3b2a-4620-8cac-ecae347b7553 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] HTTP exception thrown: Cannot 'attach_volume' instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f while it is in vm_state rescued Apr 17 11:02:35 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-13c8862f-3b2a-4620-8cac-ecae347b7553 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Request method failure captured: Apr 17 11:02:35 user devstack@n-api.service[72744]: request: POST /compute/v2.1/servers/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/os-volume_attachments HTTP/1.1 Apr 17 11:02:35 user devstack@n-api.service[72744]: Accept: application/json Apr 17 11:02:35 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 11:02:35 user devstack@n-api.service[72744]: Connection: close Apr 17 11:02:35 user devstack@n-api.service[72744]: Content-Length: 74 Apr 17 11:02:35 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 11:02:35 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 11:02:35 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 11:02:35 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 11:02:35 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSW-MrZeODEec0-GgKUVgcRRo9sR4IeW6R89M43QejliWYRYWbCdjzy6wRMS_cGtnxUrDzja9_DSrU_6Fw-WleIpEonGoJmFRMs8ds6cyemfdZByXsb2oi00E8GmlY0wlg6_XxhRgCWsYq5BBZzlT8hJjqZ7UMV7PuzjMaKmHClTbJ4 Apr 17 11:02:35 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 11:02:35 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 11:02:35 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 11:02:35 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 11:02:35 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 11:02:35 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 11:02:35 user devstack@n-api.service[72744]: X-Project-Id: 3747b7d3c6844772b0e6eed5299053ba Apr 17 11:02:35 user devstack@n-api.service[72744]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1988041396 Apr 17 11:02:35 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 11:02:35 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 11:02:35 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3747b7d3c6844772b0e6eed5299053ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3747b7d3c6844772b0e6eed5299053ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3747b7d3c6844772b0e6eed5299053ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:02:35 user devstack@n-api.service[72744]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1988041396 Apr 17 11:02:35 user devstack@n-api.service[72744]: X-Tenant-Id: 3747b7d3c6844772b0e6eed5299053ba Apr 17 11:02:35 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1988041396 Apr 17 11:02:35 user devstack@n-api.service[72744]: X-User: tempest-ServerRescueNegativeTestJSON-1988041396-project-member Apr 17 11:02:35 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 11:02:35 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 11:02:35 user devstack@n-api.service[72744]: X-User-Id: 30c15ce534a649ae8a971b33221e2500 Apr 17 11:02:35 user devstack@n-api.service[72744]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1988041396-project-member Apr 17 11:02:35 user devstack@n-api.service[72744]: Apr 17 11:02:35 user devstack@n-api.service[72744]: {"volumeAttachment": {"volumeId": "256ac907-1109-466b-a421-dc0a4b4f6266"}} Apr 17 11:02:35 user devstack@n-api.service[72744]: method: > Apr 17 11:02:35 user devstack@n-api.service[72744]: exception: Cannot 'attach_volume' instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f while it is in vm_state rescued Apr 17 11:02:35 user devstack@n-api.service[72744]: action_args: {'server_id': '06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f', 'body': {'volumeAttachment': {'volumeId': '256ac907-1109-466b-a421-dc0a4b4f6266'}}} Apr 17 11:02:35 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f while it is in vm_state rescued Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f while it is in vm_state rescued Apr 17 11:02:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:02:35 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-13c8862f-3b2a-4620-8cac-ecae347b7553 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Returning 409 to user: Cannot 'attach_volume' instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f while it is in vm_state rescued {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:02:35 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-13c8862f-3b2a-4620-8cac-ecae347b7553 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "POST /compute/v2.1/servers/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042656 Apr 17 11:02:35 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 305/947] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Apr 17 11:02:35 2023] POST /compute/v2.1/servers/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 17 11:02:35 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:02:35 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:02:35 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:02:35 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=4 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:02:35 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-419b0e9b-363b-4ba9-a63d-aa558e38b8fa tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:02:35 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-419b0e9b-363b-4ba9-a63d-aa558e38b8fa tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:02:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-419b0e9b-363b-4ba9-a63d-aa558e38b8fa tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:02:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-419b0e9b-363b-4ba9-a63d-aa558e38b8fa tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:02:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-419b0e9b-363b-4ba9-a63d-aa558e38b8fa tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:02:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-419b0e9b-363b-4ba9-a63d-aa558e38b8fa tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:02:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-419b0e9b-363b-4ba9-a63d-aa558e38b8fa tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:02:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-419b0e9b-363b-4ba9-a63d-aa558e38b8fa tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:02:35 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-419b0e9b-363b-4ba9-a63d-aa558e38b8fa tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "POST /compute/v2.1/servers/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/action" status: 202 len: 0 microversion: 2.1 time: 0.087451 Apr 17 11:02:35 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 325/948] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 11:02:35 2023] POST /compute/v2.1/servers/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 11:02:35 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-4f20bf05-a9f5-4dbd-a763-dbd693780e5d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:02:35 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-4f20bf05-a9f5-4dbd-a763-dbd693780e5d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:02:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4f20bf05-a9f5-4dbd-a763-dbd693780e5d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:02:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4f20bf05-a9f5-4dbd-a763-dbd693780e5d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:02:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4f20bf05-a9f5-4dbd-a763-dbd693780e5d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:02:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4f20bf05-a9f5-4dbd-a763-dbd693780e5d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:02:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4f20bf05-a9f5-4dbd-a763-dbd693780e5d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:02:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4f20bf05-a9f5-4dbd-a763-dbd693780e5d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:02:35 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-4f20bf05-a9f5-4dbd-a763-dbd693780e5d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c15ce534a649ae8a971b33221e2500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747b7d3c6844772b0e6eed5299053ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:02:35 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-4f20bf05-a9f5-4dbd-a763-dbd693780e5d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" status: 200 len: 1497 microversion: 2.1 time: 0.365495 Apr 17 11:02:35 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 319/949] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:02:35 2023] GET /compute/v2.1/servers/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f => generated 1497 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:02:36 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-ae16a9e8-f2bc-4a93-94d3-b8b9fb9707b5 req-ff7df510-1ea5-4d40-9b09-bb69f3e00162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f", "name": "network-vif-unplugged", "status": "completed", "tag": "9c6c71a5-0190-4112-9044-5c238344dc88"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:02:36 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-ae16a9e8-f2bc-4a93-94d3-b8b9fb9707b5 req-ff7df510-1ea5-4d40-9b09-bb69f3e00162 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:02:36 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-ae16a9e8-f2bc-4a93-94d3-b8b9fb9707b5 req-ff7df510-1ea5-4d40-9b09-bb69f3e00162 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:02:36 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-ae16a9e8-f2bc-4a93-94d3-b8b9fb9707b5 req-ff7df510-1ea5-4d40-9b09-bb69f3e00162 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:02:36 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-ae16a9e8-f2bc-4a93-94d3-b8b9fb9707b5 req-ff7df510-1ea5-4d40-9b09-bb69f3e00162 service nova] Creating event network-vif-unplugged:9c6c71a5-0190-4112-9044-5c238344dc88 for instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f on user Apr 17 11:02:36 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-ae16a9e8-f2bc-4a93-94d3-b8b9fb9707b5 req-ff7df510-1ea5-4d40-9b09-bb69f3e00162 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092194 Apr 17 11:02:36 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 306/950] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:02:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:02:36 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-a976bbb7-ec0f-4ba4-836a-6559daca54d8 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:02:36 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-a976bbb7-ec0f-4ba4-836a-6559daca54d8 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:02:36 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a976bbb7-ec0f-4ba4-836a-6559daca54d8 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:02:36 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a976bbb7-ec0f-4ba4-836a-6559daca54d8 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:02:36 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a976bbb7-ec0f-4ba4-836a-6559daca54d8 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:02:36 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a976bbb7-ec0f-4ba4-836a-6559daca54d8 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:02:36 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a976bbb7-ec0f-4ba4-836a-6559daca54d8 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:02:36 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a976bbb7-ec0f-4ba4-836a-6559daca54d8 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:02:36 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-a976bbb7-ec0f-4ba4-836a-6559daca54d8 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:02:36 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-a976bbb7-ec0f-4ba4-836a-6559daca54d8 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" status: 200 len: 1427 microversion: 2.1 time: 0.219137 Apr 17 11:02:36 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 326/951] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:02:36 2023] GET /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e => generated 1427 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:02:38 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-4281f014-0944-4340-8cb5-82fbe80fb6c2 req-ee5486e4-3754-44de-8621-f3796d4be8af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f", "name": "network-vif-plugged", "status": "completed", "tag": "9c6c71a5-0190-4112-9044-5c238344dc88"}, {"server_uuid": "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f", "name": "network-vif-plugged", "status": "completed", "tag": "9c6c71a5-0190-4112-9044-5c238344dc88"}, {"server_uuid": "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f", "name": "network-vif-plugged", "status": "completed", "tag": "9c6c71a5-0190-4112-9044-5c238344dc88"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:02:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-4281f014-0944-4340-8cb5-82fbe80fb6c2 req-ee5486e4-3754-44de-8621-f3796d4be8af service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:02:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-4281f014-0944-4340-8cb5-82fbe80fb6c2 req-ee5486e4-3754-44de-8621-f3796d4be8af service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:02:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-4281f014-0944-4340-8cb5-82fbe80fb6c2 req-ee5486e4-3754-44de-8621-f3796d4be8af service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:02:38 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-4281f014-0944-4340-8cb5-82fbe80fb6c2 req-ee5486e4-3754-44de-8621-f3796d4be8af service nova] Creating event network-vif-plugged:9c6c71a5-0190-4112-9044-5c238344dc88 for instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f on user Apr 17 11:02:38 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-4281f014-0944-4340-8cb5-82fbe80fb6c2 req-ee5486e4-3754-44de-8621-f3796d4be8af service nova] Creating event network-vif-plugged:9c6c71a5-0190-4112-9044-5c238344dc88 for instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f on user Apr 17 11:02:38 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-4281f014-0944-4340-8cb5-82fbe80fb6c2 req-ee5486e4-3754-44de-8621-f3796d4be8af service nova] Creating event network-vif-plugged:9c6c71a5-0190-4112-9044-5c238344dc88 for instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f on user Apr 17 11:02:38 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-4281f014-0944-4340-8cb5-82fbe80fb6c2 req-ee5486e4-3754-44de-8621-f3796d4be8af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.031414 Apr 17 11:02:38 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 320/952] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:02:38 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:03:05 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=4 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:03:05 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:03:05 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-650856f7-bc2c-4ce4-9113-5ead0d15c38a tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:03:05 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-650856f7-bc2c-4ce4-9113-5ead0d15c38a tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:03:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-650856f7-bc2c-4ce4-9113-5ead0d15c38a tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:03:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-650856f7-bc2c-4ce4-9113-5ead0d15c38a tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:03:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-650856f7-bc2c-4ce4-9113-5ead0d15c38a tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:03:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-650856f7-bc2c-4ce4-9113-5ead0d15c38a tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:03:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-650856f7-bc2c-4ce4-9113-5ead0d15c38a tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:03:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-650856f7-bc2c-4ce4-9113-5ead0d15c38a tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:03:05 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-650856f7-bc2c-4ce4-9113-5ead0d15c38a tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:03:05 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-650856f7-bc2c-4ce4-9113-5ead0d15c38a tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/602fd731-58b4-42fc-abe5-8428f7ff0d1d" status: 200 len: 1441 microversion: 2.1 time: 0.224261 Apr 17 11:03:05 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 307/953] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:03:05 2023] GET /compute/v2.1/servers/602fd731-58b4-42fc-abe5-8428f7ff0d1d => generated 1441 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:03:25 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-35ebe252-b6dc-4664-9f81-da98dffe53e9 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:03:25 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-35ebe252-b6dc-4664-9f81-da98dffe53e9 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:03:25 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=4 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:03:25 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:03:25 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-35ebe252-b6dc-4664-9f81-da98dffe53e9 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:03:25 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-35ebe252-b6dc-4664-9f81-da98dffe53e9 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:03:25 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-35ebe252-b6dc-4664-9f81-da98dffe53e9 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:03:25 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-35ebe252-b6dc-4664-9f81-da98dffe53e9 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:03:25 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-35ebe252-b6dc-4664-9f81-da98dffe53e9 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:03:25 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-35ebe252-b6dc-4664-9f81-da98dffe53e9 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:03:25 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-35ebe252-b6dc-4664-9f81-da98dffe53e9 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c15ce534a649ae8a971b33221e2500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747b7d3c6844772b0e6eed5299053ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:03:25 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-35ebe252-b6dc-4664-9f81-da98dffe53e9 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" status: 200 len: 1503 microversion: 2.1 time: 0.247868 Apr 17 11:03:25 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 327/954] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:03:25 2023] GET /compute/v2.1/servers/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f => generated 1503 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:03:36 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:03:36 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=10 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:03:36 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-2adbf02c-dbde-4ca3-97e3-7125d581534d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:03:36 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-2adbf02c-dbde-4ca3-97e3-7125d581534d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:03:36 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2adbf02c-dbde-4ca3-97e3-7125d581534d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:03:36 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2adbf02c-dbde-4ca3-97e3-7125d581534d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:03:36 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2adbf02c-dbde-4ca3-97e3-7125d581534d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:03:36 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2adbf02c-dbde-4ca3-97e3-7125d581534d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:03:36 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2adbf02c-dbde-4ca3-97e3-7125d581534d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:03:36 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-2adbf02c-dbde-4ca3-97e3-7125d581534d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:03:37 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-2adbf02c-dbde-4ca3-97e3-7125d581534d tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.157318 Apr 17 11:03:37 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 321/955] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 17 11:03:36 2023] GET /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e/os-interface => generated 282 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:03:37 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-3b54b78a-892c-456e-be13-e4351dd0dd19 req-5398859a-8720-4daf-a04e-a8659ab89bdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e25766f-ccf8-435e-9d56-1f371d52bbcf", "tag": "50e629ae-2997-44f7-985a-9f0b73c8e576"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:03:37 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:03:37 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:03:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-3b54b78a-892c-456e-be13-e4351dd0dd19 req-5398859a-8720-4daf-a04e-a8659ab89bdf service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:03:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-3b54b78a-892c-456e-be13-e4351dd0dd19 req-5398859a-8720-4daf-a04e-a8659ab89bdf service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:03:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-3b54b78a-892c-456e-be13-e4351dd0dd19 req-5398859a-8720-4daf-a04e-a8659ab89bdf service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:03:37 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-3b54b78a-892c-456e-be13-e4351dd0dd19 req-5398859a-8720-4daf-a04e-a8659ab89bdf service nova] Creating event network-changed:50e629ae-2997-44f7-985a-9f0b73c8e576 for instance 3e25766f-ccf8-435e-9d56-1f371d52bbcf on user Apr 17 11:03:37 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-289f57b2-d871-4fe8-9f31-d3e57e2bb6e8 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:03:37 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-289f57b2-d871-4fe8-9f31-d3e57e2bb6e8 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:03:37 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-3b54b78a-892c-456e-be13-e4351dd0dd19 req-5398859a-8720-4daf-a04e-a8659ab89bdf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039373 Apr 17 11:03:37 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 308/956] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:03:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:03:37 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:03:37 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:03:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-289f57b2-d871-4fe8-9f31-d3e57e2bb6e8 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:03:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-289f57b2-d871-4fe8-9f31-d3e57e2bb6e8 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:03:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-289f57b2-d871-4fe8-9f31-d3e57e2bb6e8 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:03:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-289f57b2-d871-4fe8-9f31-d3e57e2bb6e8 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:03:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-289f57b2-d871-4fe8-9f31-d3e57e2bb6e8 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:03:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-289f57b2-d871-4fe8-9f31-d3e57e2bb6e8 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:03:38 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-289f57b2-d871-4fe8-9f31-d3e57e2bb6e8 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:03:38 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-289f57b2-d871-4fe8-9f31-d3e57e2bb6e8 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" status: 200 len: 1427 microversion: 2.1 time: 0.226903 Apr 17 11:03:38 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 328/957] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:03:37 2023] GET /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e => generated 1427 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:03:38 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:03:38 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:03:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:03:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:03:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:03:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:03:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:03:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:03:38 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:03:38 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Old instance type m1.nano, new instance type m1.micro {{(pid=72743) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 17 11:03:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:03:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:03:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:03:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:03:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:03:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:03:38 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting quotas for project cc1b39ff9581474b87c58164e5cafa00. Resources: {'cores', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 11:03:38 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Getting quotas for user a7e218d771db49e88d13d3b088f3d88a and project cc1b39ff9581474b87c58164e5cafa00. Resources: {'cores', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 11:03:38 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flavor limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 11:03:38 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Image limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 11:03:38 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Flavor pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 11:03:38 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Image pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 11:03:38 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 11:03:38 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-389000fa-46a0-411c-a9cd-12feb5c4aa10 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "POST /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e/action" status: 202 len: 0 microversion: 2.1 time: 0.275780 Apr 17 11:03:38 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 322/958] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 11:03:38 2023] POST /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 11:03:38 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-fb4f3b66-3728-408b-91d2-cb1d814b6a1b tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:03:38 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-fb4f3b66-3728-408b-91d2-cb1d814b6a1b tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:03:38 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-fb4f3b66-3728-408b-91d2-cb1d814b6a1b tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:03:38 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-fb4f3b66-3728-408b-91d2-cb1d814b6a1b tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:03:38 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-fb4f3b66-3728-408b-91d2-cb1d814b6a1b tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:03:38 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-fb4f3b66-3728-408b-91d2-cb1d814b6a1b tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:03:38 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-fb4f3b66-3728-408b-91d2-cb1d814b6a1b tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:03:38 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-fb4f3b66-3728-408b-91d2-cb1d814b6a1b tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:03:38 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-fb4f3b66-3728-408b-91d2-cb1d814b6a1b tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:03:38 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-fb4f3b66-3728-408b-91d2-cb1d814b6a1b tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" status: 200 len: 1436 microversion: 2.1 time: 0.152129 Apr 17 11:03:38 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 309/959] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:03:38 2023] GET /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e => generated 1436 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:03:39 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-4662e1a1-ba56-46ba-9d10-03466d591741 req-fb4fc0b2-d298-4397-813a-639f9b9cae5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e", "tag": "2ddba1ca-b737-4b90-9348-3f302831a57f"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:03:39 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-4662e1a1-ba56-46ba-9d10-03466d591741 req-fb4fc0b2-d298-4397-813a-639f9b9cae5f service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:03:39 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-4662e1a1-ba56-46ba-9d10-03466d591741 req-fb4fc0b2-d298-4397-813a-639f9b9cae5f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:03:39 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-4662e1a1-ba56-46ba-9d10-03466d591741 req-fb4fc0b2-d298-4397-813a-639f9b9cae5f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:03:39 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-4662e1a1-ba56-46ba-9d10-03466d591741 req-fb4fc0b2-d298-4397-813a-639f9b9cae5f service nova] Creating event network-changed:2ddba1ca-b737-4b90-9348-3f302831a57f for instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e on user Apr 17 11:03:40 user devstack@n-api.service[72745]: DEBUG nova.compute.api [req-4662e1a1-ba56-46ba-9d10-03466d591741 req-fb4fc0b2-d298-4397-813a-639f9b9cae5f service nova] Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 17 11:03:40 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-4662e1a1-ba56-46ba-9d10-03466d591741 req-fb4fc0b2-d298-4397-813a-639f9b9cae5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042429 Apr 17 11:03:40 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 329/960] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:03:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:03:41 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-26c48eb6-c301-4e92-be24-7471d487d5c9 req-befbbb27-f384-409c-8d67-af4fcc6a344e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e", "name": "network-vif-unplugged", "status": "completed", "tag": "2ddba1ca-b737-4b90-9348-3f302831a57f"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:03:41 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-26c48eb6-c301-4e92-be24-7471d487d5c9 req-befbbb27-f384-409c-8d67-af4fcc6a344e service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:03:41 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-26c48eb6-c301-4e92-be24-7471d487d5c9 req-befbbb27-f384-409c-8d67-af4fcc6a344e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:03:41 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-26c48eb6-c301-4e92-be24-7471d487d5c9 req-befbbb27-f384-409c-8d67-af4fcc6a344e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:03:41 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-26c48eb6-c301-4e92-be24-7471d487d5c9 req-befbbb27-f384-409c-8d67-af4fcc6a344e service nova] Creating event network-vif-unplugged:2ddba1ca-b737-4b90-9348-3f302831a57f for instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e on user Apr 17 11:03:41 user devstack@n-api.service[72743]: DEBUG nova.compute.api [req-26c48eb6-c301-4e92-be24-7471d487d5c9 req-befbbb27-f384-409c-8d67-af4fcc6a344e service nova] Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72743) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 17 11:03:41 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-26c48eb6-c301-4e92-be24-7471d487d5c9 req-befbbb27-f384-409c-8d67-af4fcc6a344e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043724 Apr 17 11:03:41 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 323/961] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:03:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:03:43 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e", "name": "network-vif-plugged", "status": "completed", "tag": "2ddba1ca-b737-4b90-9348-3f302831a57f"}, {"server_uuid": "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e", "name": "network-vif-plugged", "status": "completed", "tag": "2ddba1ca-b737-4b90-9348-3f302831a57f"}, {"server_uuid": "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e", "name": "network-vif-plugged", "status": "completed", "tag": "2ddba1ca-b737-4b90-9348-3f302831a57f"}, {"server_uuid": "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e", "name": "network-vif-unplugged", "status": "completed", "tag": "2ddba1ca-b737-4b90-9348-3f302831a57f"}, {"server_uuid": "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e", "name": "network-vif-plugged", "status": "completed", "tag": "2ddba1ca-b737-4b90-9348-3f302831a57f"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:03:43 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:03:43 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:03:43 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:03:43 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] Creating event network-vif-plugged:2ddba1ca-b737-4b90-9348-3f302831a57f for instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e on user Apr 17 11:03:43 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] Creating event network-vif-plugged:2ddba1ca-b737-4b90-9348-3f302831a57f for instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e on user Apr 17 11:03:43 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] Creating event network-vif-plugged:2ddba1ca-b737-4b90-9348-3f302831a57f for instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e on user Apr 17 11:03:43 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] Creating event network-vif-unplugged:2ddba1ca-b737-4b90-9348-3f302831a57f for instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e on user Apr 17 11:03:43 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] Creating event network-vif-plugged:2ddba1ca-b737-4b90-9348-3f302831a57f for instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e on user Apr 17 11:03:43 user devstack@n-api.service[72744]: DEBUG nova.compute.api [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72744) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 17 11:03:43 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-09985b29-b434-4029-b89e-aefc3229518b req-077bf013-7f8b-471f-9d2c-6ba41e552bf2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.036748 Apr 17 11:03:43 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 310/962] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:03:43 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:03:52 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=4 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:03:52 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=10 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:03:52 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-fc4a2039-d5c4-4fbd-9a13-99425e834e99 req-18042bed-1faf-4c4d-82f8-b02ec096f084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e", "name": "network-vif-plugged", "status": "completed", "tag": "2ddba1ca-b737-4b90-9348-3f302831a57f"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:03:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-fc4a2039-d5c4-4fbd-9a13-99425e834e99 req-18042bed-1faf-4c4d-82f8-b02ec096f084 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:03:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-fc4a2039-d5c4-4fbd-9a13-99425e834e99 req-18042bed-1faf-4c4d-82f8-b02ec096f084 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:03:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-fc4a2039-d5c4-4fbd-9a13-99425e834e99 req-18042bed-1faf-4c4d-82f8-b02ec096f084 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:03:52 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-fc4a2039-d5c4-4fbd-9a13-99425e834e99 req-18042bed-1faf-4c4d-82f8-b02ec096f084 service nova] Creating event network-vif-plugged:2ddba1ca-b737-4b90-9348-3f302831a57f for instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e on user Apr 17 11:03:52 user devstack@n-api.service[72745]: DEBUG nova.compute.api [req-fc4a2039-d5c4-4fbd-9a13-99425e834e99 req-18042bed-1faf-4c4d-82f8-b02ec096f084 service nova] Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72745) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 17 11:03:52 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-fc4a2039-d5c4-4fbd-9a13-99425e834e99 req-18042bed-1faf-4c4d-82f8-b02ec096f084 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039549 Apr 17 11:03:52 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 330/963] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:03:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:03:54 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=3 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:03:54 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=18 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:03:54 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:03:54 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-1d60290d-33f4-4d24-a3eb-f3e0d654d8e8 req-45caee98-d72a-4d55-93f3-6401d0e07db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e", "name": "network-vif-plugged", "status": "completed", "tag": "2ddba1ca-b737-4b90-9348-3f302831a57f"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:03:54 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-1d60290d-33f4-4d24-a3eb-f3e0d654d8e8 req-45caee98-d72a-4d55-93f3-6401d0e07db9 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:03:54 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-1d60290d-33f4-4d24-a3eb-f3e0d654d8e8 req-45caee98-d72a-4d55-93f3-6401d0e07db9 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:03:54 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-1d60290d-33f4-4d24-a3eb-f3e0d654d8e8 req-45caee98-d72a-4d55-93f3-6401d0e07db9 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:03:54 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-1d60290d-33f4-4d24-a3eb-f3e0d654d8e8 req-45caee98-d72a-4d55-93f3-6401d0e07db9 service nova] Creating event network-vif-plugged:2ddba1ca-b737-4b90-9348-3f302831a57f for instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e on user Apr 17 11:03:54 user devstack@n-api.service[72743]: DEBUG nova.compute.api [req-1d60290d-33f4-4d24-a3eb-f3e0d654d8e8 req-45caee98-d72a-4d55-93f3-6401d0e07db9 service nova] Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72743) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 17 11:03:54 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-1d60290d-33f4-4d24-a3eb-f3e0d654d8e8 req-45caee98-d72a-4d55-93f3-6401d0e07db9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055172 Apr 17 11:03:54 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 324/964] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:03:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:04:05 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:04:05 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=12 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:04:05 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-dd46fd4e-eca7-48a0-a468-afa557e8c754 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:04:05 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-dd46fd4e-eca7-48a0-a468-afa557e8c754 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:04:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dd46fd4e-eca7-48a0-a468-afa557e8c754 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:04:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dd46fd4e-eca7-48a0-a468-afa557e8c754 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:04:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dd46fd4e-eca7-48a0-a468-afa557e8c754 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:04:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dd46fd4e-eca7-48a0-a468-afa557e8c754 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:04:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dd46fd4e-eca7-48a0-a468-afa557e8c754 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:04:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dd46fd4e-eca7-48a0-a468-afa557e8c754 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:04:05 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-dd46fd4e-eca7-48a0-a468-afa557e8c754 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:04:05 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-dd46fd4e-eca7-48a0-a468-afa557e8c754 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/602fd731-58b4-42fc-abe5-8428f7ff0d1d" status: 200 len: 1441 microversion: 2.1 time: 0.211323 Apr 17 11:04:05 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 311/965] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:04:05 2023] GET /compute/v2.1/servers/602fd731-58b4-42fc-abe5-8428f7ff0d1d => generated 1441 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:04:07 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:04:07 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=4 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:04:07 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-323d403b-a70a-4958-a2c4-bfa097dfef90 req-a7b59bae-165f-44ed-9842-17724f809ffa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "602fd731-58b4-42fc-abe5-8428f7ff0d1d", "tag": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:04:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-323d403b-a70a-4958-a2c4-bfa097dfef90 req-a7b59bae-165f-44ed-9842-17724f809ffa service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:04:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-323d403b-a70a-4958-a2c4-bfa097dfef90 req-a7b59bae-165f-44ed-9842-17724f809ffa service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:04:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-323d403b-a70a-4958-a2c4-bfa097dfef90 req-a7b59bae-165f-44ed-9842-17724f809ffa service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:04:07 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-323d403b-a70a-4958-a2c4-bfa097dfef90 req-a7b59bae-165f-44ed-9842-17724f809ffa service nova] Creating event network-changed:1ec35855-d3ca-49fe-8ea3-a810145ee9c8 for instance 602fd731-58b4-42fc-abe5-8428f7ff0d1d on user Apr 17 11:04:07 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-323d403b-a70a-4958-a2c4-bfa097dfef90 req-a7b59bae-165f-44ed-9842-17724f809ffa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092804 Apr 17 11:04:07 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 331/966] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:04:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:04:14 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:04:14 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=4 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:04:14 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1491599674", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-44084031", "security_groups": [{"name": "tempest-secgroup-smoke-1508463427"}], "block_device_mapping_v2": [{"uuid": "e82762bd-edd9-4439-b3ee-c09fe883a407", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2fc1cd4-860e-4abd-8e33-e797799c466f"}]}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:04:15 user devstack@n-api.service[72743]: DEBUG nova.network.neutron [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] validate_networks() for [('b2fc1cd4-860e-4abd-8e33-e797799c466f', None, None, None, None, None)] {{(pid=72743) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 11:04:15 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flavor limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 11:04:15 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Image limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 11:04:15 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Flavor pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 11:04:15 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Image pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 11:04:15 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 11:04:15 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:04:15 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:04:15 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:04:15 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:04:15 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:04:15 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:04:15 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Getting quotas for project 4fc3b8e3925847d48b522206a8875d3f. Resources: {'cores', 'instances', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 11:04:15 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Getting quotas for user 0e4ed1192974484bba2d4392f4d011c2 and project 4fc3b8e3925847d48b522206a8875d3f. Resources: {'cores', 'instances', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 11:04:15 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Going to run 1 instances... {{(pid=72743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 11:04:15 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e82762bd-edd9-4439-b3ee-c09fe883a407',volume_size=None,volume_type=None)] {{(pid=72743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 11:04:15 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-45394b19-78da-49dd-966c-57e6e7559488 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.776480 Apr 17 11:04:15 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 325/967] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 11:04:14 2023] POST /compute/v2.1/servers => generated 404 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 11:04:15 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-e0379bb2-e175-4ae3-8f1e-b84ae92c80ca tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:04:15 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-e0379bb2-e175-4ae3-8f1e-b84ae92c80ca tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:04:15 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-e0379bb2-e175-4ae3-8f1e-b84ae92c80ca tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:04:15 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-e0379bb2-e175-4ae3-8f1e-b84ae92c80ca tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91012a2c-0ff4-4b71-a673-7739865ba48f" status: 200 len: 1088 microversion: 2.1 time: 0.067091 Apr 17 11:04:15 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 312/968] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:04:15 2023] GET /compute/v2.1/servers/91012a2c-0ff4-4b71-a673-7739865ba48f => generated 1088 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:04:18 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:04:18 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:04:18 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-030e39d5-810e-441d-aacf-a52e3e849f5b req-eb01bd33-6c5a-4b33-a078-5a539ea22686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91012a2c-0ff4-4b71-a673-7739865ba48f", "tag": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:04:18 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-030e39d5-810e-441d-aacf-a52e3e849f5b req-eb01bd33-6c5a-4b33-a078-5a539ea22686 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:04:18 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-030e39d5-810e-441d-aacf-a52e3e849f5b req-eb01bd33-6c5a-4b33-a078-5a539ea22686 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:04:18 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-030e39d5-810e-441d-aacf-a52e3e849f5b req-eb01bd33-6c5a-4b33-a078-5a539ea22686 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:04:18 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-030e39d5-810e-441d-aacf-a52e3e849f5b req-eb01bd33-6c5a-4b33-a078-5a539ea22686 service nova] Creating event network-changed:e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 for instance 91012a2c-0ff4-4b71-a673-7739865ba48f on user Apr 17 11:04:18 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-030e39d5-810e-441d-aacf-a52e3e849f5b req-eb01bd33-6c5a-4b33-a078-5a539ea22686 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037098 Apr 17 11:04:18 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 332/969] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:04:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:04:24 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-f9cf6b68-274e-4cb0-9760-8cbedb647904 req-fd2b0f00-f0ab-4893-b16c-ff025a606448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91012a2c-0ff4-4b71-a673-7739865ba48f", "name": "network-vif-plugged", "status": "completed", "tag": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:04:24 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-f9cf6b68-274e-4cb0-9760-8cbedb647904 req-fd2b0f00-f0ab-4893-b16c-ff025a606448 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:04:24 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-f9cf6b68-274e-4cb0-9760-8cbedb647904 req-fd2b0f00-f0ab-4893-b16c-ff025a606448 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:04:24 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-f9cf6b68-274e-4cb0-9760-8cbedb647904 req-fd2b0f00-f0ab-4893-b16c-ff025a606448 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:04:24 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-f9cf6b68-274e-4cb0-9760-8cbedb647904 req-fd2b0f00-f0ab-4893-b16c-ff025a606448 service nova] Creating event network-vif-plugged:e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 for instance 91012a2c-0ff4-4b71-a673-7739865ba48f on user Apr 17 11:04:24 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-f9cf6b68-274e-4cb0-9760-8cbedb647904 req-fd2b0f00-f0ab-4893-b16c-ff025a606448 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029142 Apr 17 11:04:24 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 326/970] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:04:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:04:26 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-6ad00158-72d0-4745-9c22-2a4175380129 req-0a31f954-209f-4e9d-a086-c3c7f74a7d15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91012a2c-0ff4-4b71-a673-7739865ba48f", "name": "network-vif-plugged", "status": "completed", "tag": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:04:26 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:04:26 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:04:26 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:04:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-6ad00158-72d0-4745-9c22-2a4175380129 req-0a31f954-209f-4e9d-a086-c3c7f74a7d15 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:04:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-6ad00158-72d0-4745-9c22-2a4175380129 req-0a31f954-209f-4e9d-a086-c3c7f74a7d15 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:04:26 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-6ad00158-72d0-4745-9c22-2a4175380129 req-0a31f954-209f-4e9d-a086-c3c7f74a7d15 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:04:26 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-6ad00158-72d0-4745-9c22-2a4175380129 req-0a31f954-209f-4e9d-a086-c3c7f74a7d15 service nova] Creating event network-vif-plugged:e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 for instance 91012a2c-0ff4-4b71-a673-7739865ba48f on user Apr 17 11:04:26 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-6ad00158-72d0-4745-9c22-2a4175380129 req-0a31f954-209f-4e9d-a086-c3c7f74a7d15 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037641 Apr 17 11:04:26 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 313/971] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:04:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:04:28 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:04:28 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:04:28 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-a9a4e8a0-f125-44a7-ba53-1645221c18b1 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Action: 'create', calling method: .version_select at 0x7fc55a630ca0>, body: {"keypair": {"name": "tempest-keypair-1731392485", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6bMYvwfR2NSZpa2Rl+5bZN+PeHM2NB1gHPlHIxTKr9aoqPNqunUDQK+9/cINh0G+oADlw0LFutBwblzU3KSmGbya/iJCiHB43XjPicDxDHVCt+iJIqTXDooiBKY1VBMQ=="}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:04:28 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-a9a4e8a0-f125-44a7-ba53-1645221c18b1 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Getting quotas for project 3747b7d3c6844772b0e6eed5299053ba. Resources: {'key_pairs'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 11:04:28 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-a9a4e8a0-f125-44a7-ba53-1645221c18b1 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Getting quotas for user 30c15ce534a649ae8a971b33221e2500 and project 3747b7d3c6844772b0e6eed5299053ba. Resources: {'key_pairs'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 11:04:28 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-a9a4e8a0-f125-44a7-ba53-1645221c18b1 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050432 Apr 17 11:04:28 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 333/972] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 11:04:28 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:04:28 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:04:28 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:04:28 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b139ad00-15b1-4c9f-b223-3188d1635b74 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:04:28 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-b139ad00-15b1-4c9f-b223-3188d1635b74 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:04:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b139ad00-15b1-4c9f-b223-3188d1635b74 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:04:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b139ad00-15b1-4c9f-b223-3188d1635b74 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:04:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b139ad00-15b1-4c9f-b223-3188d1635b74 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:04:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b139ad00-15b1-4c9f-b223-3188d1635b74 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:04:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b139ad00-15b1-4c9f-b223-3188d1635b74 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:04:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b139ad00-15b1-4c9f-b223-3188d1635b74 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:04:28 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-b139ad00-15b1-4c9f-b223-3188d1635b74 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:04:28 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-b139ad00-15b1-4c9f-b223-3188d1635b74 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" status: 200 len: 1553 microversion: 2.1 time: 0.255765 Apr 17 11:04:28 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 327/973] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:04:28 2023] GET /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e => generated 1553 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:04:30 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1289770639", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f7747405-4e8a-4372-b07e-5ebf2852fe5f"}], "security_groups": [{"name": "tempest-securitygroup--1524923724"}], "key_name": "tempest-keypair-1731392485", "user_data": "}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:04:30 user devstack@n-api.service[72744]: DEBUG nova.network.neutron [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] validate_networks() for [('f7747405-4e8a-4372-b07e-5ebf2852fe5f', None, None, None, None, None)] {{(pid=72744) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 11:04:30 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Flavor limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 11:04:30 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Image limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 11:04:30 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Flavor pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 11:04:30 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Image pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 11:04:30 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 11:04:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:04:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:04:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:04:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:04:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:04:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:04:30 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Getting quotas for project 3747b7d3c6844772b0e6eed5299053ba. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 11:04:30 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Getting quotas for user 30c15ce534a649ae8a971b33221e2500 and project 3747b7d3c6844772b0e6eed5299053ba. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 11:04:30 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Going to run 1 instances... {{(pid=72744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 11:04:30 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 11:04:30 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-6be8da2f-c4bc-4e7e-84a9-64d6857630ee tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.714308 Apr 17 11:04:30 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 314/974] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 11:04:29 2023] POST /compute/v2.1/servers => generated 407 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 11:04:30 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-21135023-f1fe-4288-9713-e6e7c40c83e5 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:04:30 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-21135023-f1fe-4288-9713-e6e7c40c83e5 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:04:30 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-21135023-f1fe-4288-9713-e6e7c40c83e5 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c15ce534a649ae8a971b33221e2500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747b7d3c6844772b0e6eed5299053ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:04:30 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-21135023-f1fe-4288-9713-e6e7c40c83e5 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" status: 200 len: 1240 microversion: 2.1 time: 0.067587 Apr 17 11:04:30 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 334/975] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:04:30 2023] GET /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:04:33 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-238095a0-a7c9-46ec-b3a1-a39c787b4ccd req-73f4cab4-9c1f-468a-b0e8-846ed75f741c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6", "tag": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:04:33 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-238095a0-a7c9-46ec-b3a1-a39c787b4ccd req-73f4cab4-9c1f-468a-b0e8-846ed75f741c service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:04:33 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-238095a0-a7c9-46ec-b3a1-a39c787b4ccd req-73f4cab4-9c1f-468a-b0e8-846ed75f741c service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:04:33 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-238095a0-a7c9-46ec-b3a1-a39c787b4ccd req-73f4cab4-9c1f-468a-b0e8-846ed75f741c service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:04:33 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-238095a0-a7c9-46ec-b3a1-a39c787b4ccd req-73f4cab4-9c1f-468a-b0e8-846ed75f741c service nova] Creating event network-changed:bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 on user Apr 17 11:04:33 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-238095a0-a7c9-46ec-b3a1-a39c787b4ccd req-73f4cab4-9c1f-468a-b0e8-846ed75f741c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029735 Apr 17 11:04:33 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 328/976] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:04:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:04:35 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-a9af81a5-d05f-416c-931d-e098500e8adb req-059d8ef5-6110-48d5-8e47-ede4536bf916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6", "name": "network-vif-plugged", "status": "completed", "tag": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:04:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-a9af81a5-d05f-416c-931d-e098500e8adb req-059d8ef5-6110-48d5-8e47-ede4536bf916 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:04:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-a9af81a5-d05f-416c-931d-e098500e8adb req-059d8ef5-6110-48d5-8e47-ede4536bf916 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:04:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-a9af81a5-d05f-416c-931d-e098500e8adb req-059d8ef5-6110-48d5-8e47-ede4536bf916 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:04:35 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-a9af81a5-d05f-416c-931d-e098500e8adb req-059d8ef5-6110-48d5-8e47-ede4536bf916 service nova] Creating event network-vif-plugged:bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 on user Apr 17 11:04:35 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-a9af81a5-d05f-416c-931d-e098500e8adb req-059d8ef5-6110-48d5-8e47-ede4536bf916 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032566 Apr 17 11:04:35 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 315/977] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:04:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:04:37 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-f738ae1b-6e52-4cc0-a923-132ad1f14ebe req-02bcd084-1404-44de-8590-4cd8dbbacec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6", "name": "network-vif-plugged", "status": "completed", "tag": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:04:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-f738ae1b-6e52-4cc0-a923-132ad1f14ebe req-02bcd084-1404-44de-8590-4cd8dbbacec5 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:04:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-f738ae1b-6e52-4cc0-a923-132ad1f14ebe req-02bcd084-1404-44de-8590-4cd8dbbacec5 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:04:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-f738ae1b-6e52-4cc0-a923-132ad1f14ebe req-02bcd084-1404-44de-8590-4cd8dbbacec5 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:04:37 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-f738ae1b-6e52-4cc0-a923-132ad1f14ebe req-02bcd084-1404-44de-8590-4cd8dbbacec5 service nova] Creating event network-vif-plugged:bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 on user Apr 17 11:04:37 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-f738ae1b-6e52-4cc0-a923-132ad1f14ebe req-02bcd084-1404-44de-8590-4cd8dbbacec5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029987 Apr 17 11:04:37 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 335/978] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:04:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:05:05 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:05:05 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=12 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:05:05 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-e0c8667c-1744-4e73-8481-2fad9057d8b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:05:05 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-e0c8667c-1744-4e73-8481-2fad9057d8b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:05:05 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e0c8667c-1744-4e73-8481-2fad9057d8b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:05:05 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e0c8667c-1744-4e73-8481-2fad9057d8b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:05:05 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e0c8667c-1744-4e73-8481-2fad9057d8b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:05:05 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e0c8667c-1744-4e73-8481-2fad9057d8b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:05:05 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e0c8667c-1744-4e73-8481-2fad9057d8b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:05:05 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e0c8667c-1744-4e73-8481-2fad9057d8b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:05:06 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-e0c8667c-1744-4e73-8481-2fad9057d8b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:05:06 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-e0c8667c-1744-4e73-8481-2fad9057d8b0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91012a2c-0ff4-4b71-a673-7739865ba48f" status: 200 len: 1441 microversion: 2.1 time: 0.301227 Apr 17 11:05:06 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 329/979] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:05:05 2023] GET /compute/v2.1/servers/91012a2c-0ff4-4b71-a673-7739865ba48f => generated 1441 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:05:20 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:05:20 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:05:20 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:05:20 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:05:20 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-2f00cdeb-a423-4505-b48a-e3a983d34750 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:05:20 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-2f00cdeb-a423-4505-b48a-e3a983d34750 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:05:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2f00cdeb-a423-4505-b48a-e3a983d34750 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:05:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2f00cdeb-a423-4505-b48a-e3a983d34750 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:05:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2f00cdeb-a423-4505-b48a-e3a983d34750 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:05:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2f00cdeb-a423-4505-b48a-e3a983d34750 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:05:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2f00cdeb-a423-4505-b48a-e3a983d34750 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:05:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-2f00cdeb-a423-4505-b48a-e3a983d34750 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:05:21 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-2f00cdeb-a423-4505-b48a-e3a983d34750 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c15ce534a649ae8a971b33221e2500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747b7d3c6844772b0e6eed5299053ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:05:21 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-2f00cdeb-a423-4505-b48a-e3a983d34750 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" status: 200 len: 1552 microversion: 2.1 time: 0.222586 Apr 17 11:05:21 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 316/980] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:05:20 2023] GET /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 => generated 1552 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:05:29 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:05:29 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:05:29 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:05:29 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-c27f712d-2ccb-4adf-9fcb-877b22423d5e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:05:29 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-c27f712d-2ccb-4adf-9fcb-877b22423d5e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:05:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c27f712d-2ccb-4adf-9fcb-877b22423d5e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:05:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c27f712d-2ccb-4adf-9fcb-877b22423d5e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:05:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c27f712d-2ccb-4adf-9fcb-877b22423d5e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:05:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c27f712d-2ccb-4adf-9fcb-877b22423d5e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:05:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c27f712d-2ccb-4adf-9fcb-877b22423d5e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:05:29 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c27f712d-2ccb-4adf-9fcb-877b22423d5e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:05:29 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-c27f712d-2ccb-4adf-9fcb-877b22423d5e tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "POST /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e/action" status: 204 len: 0 microversion: 2.1 time: 0.081290 Apr 17 11:05:29 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 336/981] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 11:05:29 2023] POST /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e/action => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 11:05:29 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-f7a1be17-c92e-4e2c-9d7c-f43db966d349 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:05:29 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-f7a1be17-c92e-4e2c-9d7c-f43db966d349 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:05:29 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:05:29 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:05:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f7a1be17-c92e-4e2c-9d7c-f43db966d349 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:05:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f7a1be17-c92e-4e2c-9d7c-f43db966d349 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:05:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f7a1be17-c92e-4e2c-9d7c-f43db966d349 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:05:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f7a1be17-c92e-4e2c-9d7c-f43db966d349 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:05:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f7a1be17-c92e-4e2c-9d7c-f43db966d349 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:05:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f7a1be17-c92e-4e2c-9d7c-f43db966d349 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:05:29 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-f7a1be17-c92e-4e2c-9d7c-f43db966d349 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:05:29 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-f7a1be17-c92e-4e2c-9d7c-f43db966d349 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" status: 200 len: 1553 microversion: 2.1 time: 0.325429 Apr 17 11:05:29 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 330/982] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:05:29 2023] GET /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e => generated 1553 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:06:06 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-0e27002a-f4e5-4d7d-80b6-5655e2273346 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:06:06 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-0e27002a-f4e5-4d7d-80b6-5655e2273346 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:06:06 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:06:06 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:06:06 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-0e27002a-f4e5-4d7d-80b6-5655e2273346 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:06:06 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-0e27002a-f4e5-4d7d-80b6-5655e2273346 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:06:06 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-0e27002a-f4e5-4d7d-80b6-5655e2273346 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:06:06 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-0e27002a-f4e5-4d7d-80b6-5655e2273346 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:06:06 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-0e27002a-f4e5-4d7d-80b6-5655e2273346 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:06:06 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-0e27002a-f4e5-4d7d-80b6-5655e2273346 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:06:06 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-0e27002a-f4e5-4d7d-80b6-5655e2273346 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:06:06 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-0e27002a-f4e5-4d7d-80b6-5655e2273346 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91012a2c-0ff4-4b71-a673-7739865ba48f" status: 200 len: 1441 microversion: 2.1 time: 0.276800 Apr 17 11:06:06 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 317/983] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:06:06 2023] GET /compute/v2.1/servers/91012a2c-0ff4-4b71-a673-7739865ba48f => generated 1441 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:06:07 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:06:07 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:06:07 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-cb9cea06-57f4-4765-bafd-0581eb74a5f8 req-2dbc7ac5-17fb-438d-a616-c7ca2fdb238f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91012a2c-0ff4-4b71-a673-7739865ba48f", "tag": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:06:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-cb9cea06-57f4-4765-bafd-0581eb74a5f8 req-2dbc7ac5-17fb-438d-a616-c7ca2fdb238f service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:06:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-cb9cea06-57f4-4765-bafd-0581eb74a5f8 req-2dbc7ac5-17fb-438d-a616-c7ca2fdb238f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:06:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-cb9cea06-57f4-4765-bafd-0581eb74a5f8 req-2dbc7ac5-17fb-438d-a616-c7ca2fdb238f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:06:07 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-cb9cea06-57f4-4765-bafd-0581eb74a5f8 req-2dbc7ac5-17fb-438d-a616-c7ca2fdb238f service nova] Creating event network-changed:e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 for instance 91012a2c-0ff4-4b71-a673-7739865ba48f on user Apr 17 11:06:07 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-cb9cea06-57f4-4765-bafd-0581eb74a5f8 req-2dbc7ac5-17fb-438d-a616-c7ca2fdb238f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037765 Apr 17 11:06:07 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 337/984] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:06:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:06:08 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:06:08 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:06:08 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:06:08 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:06:08 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-f1da8f60-749d-4952-9d87-bf29c02a0cbe req-df5e0a9a-0483-4375-a14b-2296fe975b45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91012a2c-0ff4-4b71-a673-7739865ba48f", "tag": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:06:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:06:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:06:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:06:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:06:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:06:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:06:08 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-f1da8f60-749d-4952-9d87-bf29c02a0cbe req-df5e0a9a-0483-4375-a14b-2296fe975b45 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:06:08 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-f1da8f60-749d-4952-9d87-bf29c02a0cbe req-df5e0a9a-0483-4375-a14b-2296fe975b45 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:06:08 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-f1da8f60-749d-4952-9d87-bf29c02a0cbe req-df5e0a9a-0483-4375-a14b-2296fe975b45 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:06:08 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-f1da8f60-749d-4952-9d87-bf29c02a0cbe req-df5e0a9a-0483-4375-a14b-2296fe975b45 service nova] Creating event network-changed:e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 for instance 91012a2c-0ff4-4b71-a673-7739865ba48f on user Apr 17 11:06:08 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-f1da8f60-749d-4952-9d87-bf29c02a0cbe req-df5e0a9a-0483-4375-a14b-2296fe975b45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031622 Apr 17 11:06:08 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 318/985] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:06:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:06:08 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Going to try to terminate instance {{(pid=72743) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 11:06:08 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-ade9df11-e03f-44c9-a140-6750339f94c8 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/91012a2c-0ff4-4b71-a673-7739865ba48f" status: 204 len: 0 microversion: 2.1 time: 0.150665 Apr 17 11:06:08 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 331/986] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 11:06:08 2023] DELETE /compute/v2.1/servers/91012a2c-0ff4-4b71-a673-7739865ba48f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 11:06:08 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-d7ec9a1c-cf10-488c-b1d3-21316cdd7d4f tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:06:08 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-d7ec9a1c-cf10-488c-b1d3-21316cdd7d4f tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:06:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d7ec9a1c-cf10-488c-b1d3-21316cdd7d4f tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:06:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d7ec9a1c-cf10-488c-b1d3-21316cdd7d4f tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:06:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d7ec9a1c-cf10-488c-b1d3-21316cdd7d4f tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:06:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d7ec9a1c-cf10-488c-b1d3-21316cdd7d4f tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:06:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d7ec9a1c-cf10-488c-b1d3-21316cdd7d4f tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:06:08 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d7ec9a1c-cf10-488c-b1d3-21316cdd7d4f tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:06:09 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-d7ec9a1c-cf10-488c-b1d3-21316cdd7d4f tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:06:09 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-d7ec9a1c-cf10-488c-b1d3-21316cdd7d4f tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91012a2c-0ff4-4b71-a673-7739865ba48f" status: 200 len: 1565 microversion: 2.1 time: 0.410448 Apr 17 11:06:09 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 338/987] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:06:08 2023] GET /compute/v2.1/servers/91012a2c-0ff4-4b71-a673-7739865ba48f => generated 1565 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:06:10 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-7eeb074d-67ab-4cee-bf51-7cc398b0ac7c req-b42ae358-6094-4ecd-9814-f0e83dadb95c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91012a2c-0ff4-4b71-a673-7739865ba48f", "name": "network-vif-deleted", "tag": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:06:10 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-7eeb074d-67ab-4cee-bf51-7cc398b0ac7c req-b42ae358-6094-4ecd-9814-f0e83dadb95c service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:06:10 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-7eeb074d-67ab-4cee-bf51-7cc398b0ac7c req-b42ae358-6094-4ecd-9814-f0e83dadb95c service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:06:10 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-7eeb074d-67ab-4cee-bf51-7cc398b0ac7c req-b42ae358-6094-4ecd-9814-f0e83dadb95c service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:06:10 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-7eeb074d-67ab-4cee-bf51-7cc398b0ac7c req-b42ae358-6094-4ecd-9814-f0e83dadb95c service nova] Creating event network-vif-deleted:e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 for instance 91012a2c-0ff4-4b71-a673-7739865ba48f on user Apr 17 11:06:10 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-7eeb074d-67ab-4cee-bf51-7cc398b0ac7c req-b42ae358-6094-4ecd-9814-f0e83dadb95c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028267 Apr 17 11:06:10 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 319/988] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:06:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:06:10 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-a3512757-b28d-46c5-9611-9ae9321daaf1 req-516be2f1-ca40-485a-b1a6-2b536bd62f75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91012a2c-0ff4-4b71-a673-7739865ba48f", "name": "network-vif-unplugged", "status": "completed", "tag": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5"}, {"server_uuid": "91012a2c-0ff4-4b71-a673-7739865ba48f", "name": "network-vif-plugged", "status": "completed", "tag": "e1d8dd97-a6ef-499b-8bd6-ad45b3794df5"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:06:10 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-a3512757-b28d-46c5-9611-9ae9321daaf1 req-516be2f1-ca40-485a-b1a6-2b536bd62f75 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:06:10 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-a3512757-b28d-46c5-9611-9ae9321daaf1 req-516be2f1-ca40-485a-b1a6-2b536bd62f75 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:06:10 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-a3512757-b28d-46c5-9611-9ae9321daaf1 req-516be2f1-ca40-485a-b1a6-2b536bd62f75 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:06:10 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-a3512757-b28d-46c5-9611-9ae9321daaf1 req-516be2f1-ca40-485a-b1a6-2b536bd62f75 service nova] Creating event network-vif-unplugged:e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 for instance 91012a2c-0ff4-4b71-a673-7739865ba48f on user Apr 17 11:06:10 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-a3512757-b28d-46c5-9611-9ae9321daaf1 req-516be2f1-ca40-485a-b1a6-2b536bd62f75 service nova] Creating event network-vif-plugged:e1d8dd97-a6ef-499b-8bd6-ad45b3794df5 for instance 91012a2c-0ff4-4b71-a673-7739865ba48f on user Apr 17 11:06:10 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-a3512757-b28d-46c5-9611-9ae9321daaf1 req-516be2f1-ca40-485a-b1a6-2b536bd62f75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.032418 Apr 17 11:06:10 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 332/989] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:06:10 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:06:19 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-7fd4cdc7-b26a-4b2b-ab5e-6f5110eb4b88 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:06:19 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-7fd4cdc7-b26a-4b2b-ab5e-6f5110eb4b88 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:06:19 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=4 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:06:19 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=8 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:06:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7fd4cdc7-b26a-4b2b-ab5e-6f5110eb4b88 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:06:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7fd4cdc7-b26a-4b2b-ab5e-6f5110eb4b88 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:06:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7fd4cdc7-b26a-4b2b-ab5e-6f5110eb4b88 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:06:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7fd4cdc7-b26a-4b2b-ab5e-6f5110eb4b88 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:06:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7fd4cdc7-b26a-4b2b-ab5e-6f5110eb4b88 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:06:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7fd4cdc7-b26a-4b2b-ab5e-6f5110eb4b88 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:06:19 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-7fd4cdc7-b26a-4b2b-ab5e-6f5110eb4b88 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:06:19 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-7fd4cdc7-b26a-4b2b-ab5e-6f5110eb4b88 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" status: 200 len: 1545 microversion: 2.1 time: 0.235122 Apr 17 11:06:19 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 339/990] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:06:19 2023] GET /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e => generated 1545 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:06:21 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:06:21 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=10 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:06:21 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-4cd809b6-6c07-4370-afc4-d86e91e4007a tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:06:21 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-4cd809b6-6c07-4370-afc4-d86e91e4007a tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:06:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-4cd809b6-6c07-4370-afc4-d86e91e4007a tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:06:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-4cd809b6-6c07-4370-afc4-d86e91e4007a tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:06:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-4cd809b6-6c07-4370-afc4-d86e91e4007a tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:06:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-4cd809b6-6c07-4370-afc4-d86e91e4007a tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:06:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-4cd809b6-6c07-4370-afc4-d86e91e4007a tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:06:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-4cd809b6-6c07-4370-afc4-d86e91e4007a tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:06:21 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-4cd809b6-6c07-4370-afc4-d86e91e4007a tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.173904 Apr 17 11:06:21 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 320/991] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 17 11:06:21 2023] GET /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/os-interface => generated 282 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:06:22 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:06:22 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:06:22 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-36de4f22-9466-4113-82a5-510821a3efcd req-858ab141-c00e-4d05-a168-0346325d4134 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6", "tag": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:06:22 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-36de4f22-9466-4113-82a5-510821a3efcd req-858ab141-c00e-4d05-a168-0346325d4134 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:06:22 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-36de4f22-9466-4113-82a5-510821a3efcd req-858ab141-c00e-4d05-a168-0346325d4134 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:06:22 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-36de4f22-9466-4113-82a5-510821a3efcd req-858ab141-c00e-4d05-a168-0346325d4134 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:06:22 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-36de4f22-9466-4113-82a5-510821a3efcd req-858ab141-c00e-4d05-a168-0346325d4134 service nova] Creating event network-changed:bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 on user Apr 17 11:06:22 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-36de4f22-9466-4113-82a5-510821a3efcd req-858ab141-c00e-4d05-a168-0346325d4134 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048521 Apr 17 11:06:22 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 333/992] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:06:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:06:22 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9884dc01-fc15-48b8-935e-eef5420d68b1"}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:06:22 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:06:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:06:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:06:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:06:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:06:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:06:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:06:22 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-e3a156cc-304a-44ee-8e9a-2bf072c047a4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296943 Apr 17 11:06:22 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 340/993] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Apr 17 11:06:22 2023] POST /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:06:32 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:06:32 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=4 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:06:32 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:06:32 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:06:32 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:06:32 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:06:32 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:06:32 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:06:32 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:06:32 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:06:32 user devstack@n-api.service[72744]: DEBUG nova.objects.instance [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'flavor' on Instance uuid d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 {{(pid=72744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 11:06:32 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-36b67794-fd1f-4d13-bea8-aedf8e5840d2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/action" status: 200 len: 32 microversion: 2.1 time: 0.163591 Apr 17 11:06:32 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 321/994] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 11:06:32 2023] POST /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 17 11:06:32 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:06:32 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:06:32 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-4adfafcc-7aa4-48c2-9bfd-f50ac5eb4d42 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:06:32 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-4adfafcc-7aa4-48c2-9bfd-f50ac5eb4d42 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:06:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4adfafcc-7aa4-48c2-9bfd-f50ac5eb4d42 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:06:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4adfafcc-7aa4-48c2-9bfd-f50ac5eb4d42 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:06:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4adfafcc-7aa4-48c2-9bfd-f50ac5eb4d42 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:06:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4adfafcc-7aa4-48c2-9bfd-f50ac5eb4d42 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:06:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4adfafcc-7aa4-48c2-9bfd-f50ac5eb4d42 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:06:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4adfafcc-7aa4-48c2-9bfd-f50ac5eb4d42 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:06:32 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-4adfafcc-7aa4-48c2-9bfd-f50ac5eb4d42 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c15ce534a649ae8a971b33221e2500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747b7d3c6844772b0e6eed5299053ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:06:32 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-4adfafcc-7aa4-48c2-9bfd-f50ac5eb4d42 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" status: 200 len: 1723 microversion: 2.1 time: 0.251404 Apr 17 11:06:32 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 334/995] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:06:32 2023] GET /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:06:33 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=4 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:06:33 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:06:33 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-963ba1a3-c9c7-4e8e-aebe-077e6b9a0fd9 req-bd5f5c6b-f73f-45a8-b23f-1821e11c6c36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6", "name": "network-vif-unplugged", "status": "completed", "tag": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:06:33 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-963ba1a3-c9c7-4e8e-aebe-077e6b9a0fd9 req-bd5f5c6b-f73f-45a8-b23f-1821e11c6c36 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:06:33 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-963ba1a3-c9c7-4e8e-aebe-077e6b9a0fd9 req-bd5f5c6b-f73f-45a8-b23f-1821e11c6c36 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:06:33 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-963ba1a3-c9c7-4e8e-aebe-077e6b9a0fd9 req-bd5f5c6b-f73f-45a8-b23f-1821e11c6c36 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:06:33 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-963ba1a3-c9c7-4e8e-aebe-077e6b9a0fd9 req-bd5f5c6b-f73f-45a8-b23f-1821e11c6c36 service nova] Creating event network-vif-unplugged:bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 on user Apr 17 11:06:33 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-963ba1a3-c9c7-4e8e-aebe-077e6b9a0fd9 req-bd5f5c6b-f73f-45a8-b23f-1821e11c6c36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038867 Apr 17 11:06:33 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 341/996] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:06:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:06:35 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-2976bae1-1747-4bbb-b7e8-f561ae9c5089 req-65fd7def-1f65-446a-bcbf-e8b7a23f499a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6", "name": "network-vif-plugged", "status": "completed", "tag": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:06:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-2976bae1-1747-4bbb-b7e8-f561ae9c5089 req-65fd7def-1f65-446a-bcbf-e8b7a23f499a service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:06:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-2976bae1-1747-4bbb-b7e8-f561ae9c5089 req-65fd7def-1f65-446a-bcbf-e8b7a23f499a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:06:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-2976bae1-1747-4bbb-b7e8-f561ae9c5089 req-65fd7def-1f65-446a-bcbf-e8b7a23f499a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:06:35 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-2976bae1-1747-4bbb-b7e8-f561ae9c5089 req-65fd7def-1f65-446a-bcbf-e8b7a23f499a service nova] Creating event network-vif-plugged:bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 on user Apr 17 11:06:35 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-2976bae1-1747-4bbb-b7e8-f561ae9c5089 req-65fd7def-1f65-446a-bcbf-e8b7a23f499a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028975 Apr 17 11:06:35 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 322/997] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:06:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:06:37 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-3d0d2715-6f4d-44e5-8c37-7b680ae4b59e req-c0ea5da9-826f-44c1-be47-22652c6c34a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6", "name": "network-vif-plugged", "status": "completed", "tag": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4"}, {"server_uuid": "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6", "name": "network-vif-plugged", "status": "completed", "tag": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:06:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-3d0d2715-6f4d-44e5-8c37-7b680ae4b59e req-c0ea5da9-826f-44c1-be47-22652c6c34a3 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:06:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-3d0d2715-6f4d-44e5-8c37-7b680ae4b59e req-c0ea5da9-826f-44c1-be47-22652c6c34a3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:06:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-3d0d2715-6f4d-44e5-8c37-7b680ae4b59e req-c0ea5da9-826f-44c1-be47-22652c6c34a3 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:06:37 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-3d0d2715-6f4d-44e5-8c37-7b680ae4b59e req-c0ea5da9-826f-44c1-be47-22652c6c34a3 service nova] Creating event network-vif-plugged:bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 on user Apr 17 11:06:37 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-3d0d2715-6f4d-44e5-8c37-7b680ae4b59e req-c0ea5da9-826f-44c1-be47-22652c6c34a3 service nova] Creating event network-vif-plugged:bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 on user Apr 17 11:06:37 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-3d0d2715-6f4d-44e5-8c37-7b680ae4b59e req-c0ea5da9-826f-44c1-be47-22652c6c34a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029455 Apr 17 11:06:37 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 335/998] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:06:37 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:06:59 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:06:59 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:06:59 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-a1b1a5d6-2dd1-4fab-974d-4cedaa6c255e tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:06:59 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-a1b1a5d6-2dd1-4fab-974d-4cedaa6c255e tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 91012a2c-0ff4-4b71-a673-7739865ba48f] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:06:59 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a1b1a5d6-2dd1-4fab-974d-4cedaa6c255e tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:06:59 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a1b1a5d6-2dd1-4fab-974d-4cedaa6c255e tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:06:59 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a1b1a5d6-2dd1-4fab-974d-4cedaa6c255e tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:06:59 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a1b1a5d6-2dd1-4fab-974d-4cedaa6c255e tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:06:59 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a1b1a5d6-2dd1-4fab-974d-4cedaa6c255e tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:06:59 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-a1b1a5d6-2dd1-4fab-974d-4cedaa6c255e tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:06:59 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-a1b1a5d6-2dd1-4fab-974d-4cedaa6c255e tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] HTTP exception thrown: Instance 91012a2c-0ff4-4b71-a673-7739865ba48f could not be found. Apr 17 11:06:59 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-a1b1a5d6-2dd1-4fab-974d-4cedaa6c255e tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Request method failure captured: Apr 17 11:06:59 user devstack@n-api.service[72745]: request: GET /compute/v2.1/servers/91012a2c-0ff4-4b71-a673-7739865ba48f HTTP/1.1 Apr 17 11:06:59 user devstack@n-api.service[72745]: Accept: application/json Apr 17 11:06:59 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 11:06:59 user devstack@n-api.service[72745]: Connection: close Apr 17 11:06:59 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 11:06:59 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 11:06:59 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 11:06:59 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 11:06:59 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 11:06:59 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSSCVaY1iKFmkIuE91AAZWbZr-St_d2GFFrNXSeGSoQiDrm-J9xeGchCURDcBT2f6OJKR7j1O2xqpvL6Q1v7RUTS6S0coDZzk4yo8dpwf8dH_RMLU-Nova4o6mAYcBGkp1ZyRONF4za9zTxaNNTE8dZP8s8iS--XIiCu-N56JXP7Shg Apr 17 11:06:59 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 11:06:59 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 11:06:59 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 11:06:59 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 11:06:59 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 11:06:59 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 11:06:59 user devstack@n-api.service[72745]: X-Project-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 11:06:59 user devstack@n-api.service[72745]: X-Project-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 11:06:59 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 11:06:59 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 11:06:59 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:06:59 user devstack@n-api.service[72745]: X-Tenant: tempest-TestVolumeBootPattern-1777404437 Apr 17 11:06:59 user devstack@n-api.service[72745]: X-Tenant-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 11:06:59 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 11:06:59 user devstack@n-api.service[72745]: X-User: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 11:06:59 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 11:06:59 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 11:06:59 user devstack@n-api.service[72745]: X-User-Id: 0e4ed1192974484bba2d4392f4d011c2 Apr 17 11:06:59 user devstack@n-api.service[72745]: X-User-Name: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 11:06:59 user devstack@n-api.service[72745]: method: > Apr 17 11:06:59 user devstack@n-api.service[72745]: exception: Instance 91012a2c-0ff4-4b71-a673-7739865ba48f could not be found. Apr 17 11:06:59 user devstack@n-api.service[72745]: action_args: {'id': '91012a2c-0ff4-4b71-a673-7739865ba48f'} Apr 17 11:06:59 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91012a2c-0ff4-4b71-a673-7739865ba48f could not be found. Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91012a2c-0ff4-4b71-a673-7739865ba48f could not be found. Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91012a2c-0ff4-4b71-a673-7739865ba48f could not be found. Apr 17 11:06:59 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:06:59 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-a1b1a5d6-2dd1-4fab-974d-4cedaa6c255e tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Returning 404 to user: Instance 91012a2c-0ff4-4b71-a673-7739865ba48f could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:06:59 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-a1b1a5d6-2dd1-4fab-974d-4cedaa6c255e tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91012a2c-0ff4-4b71-a673-7739865ba48f" status: 404 len: 111 microversion: 2.1 time: 0.080213 Apr 17 11:06:59 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 342/999] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:06:59 2023] GET /compute/v2.1/servers/91012a2c-0ff4-4b71-a673-7739865ba48f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 11:07:06 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=4 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:07:06 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:07:06 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=4 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:07:06 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=8 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:07:06 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:07:06 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:07:06 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-26ab6f86-fbd6-4e73-9bb2-1bb8c69fcfcb req-c07e7998-4e29-4065-841d-5edb77026814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "602fd731-58b4-42fc-abe5-8428f7ff0d1d", "tag": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:07:06 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:07:06 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:07:06 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:07:06 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:07:06 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:07:06 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:07:06 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-26ab6f86-fbd6-4e73-9bb2-1bb8c69fcfcb req-c07e7998-4e29-4065-841d-5edb77026814 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:07:06 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-26ab6f86-fbd6-4e73-9bb2-1bb8c69fcfcb req-c07e7998-4e29-4065-841d-5edb77026814 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:07:06 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-26ab6f86-fbd6-4e73-9bb2-1bb8c69fcfcb req-c07e7998-4e29-4065-841d-5edb77026814 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:07:06 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-26ab6f86-fbd6-4e73-9bb2-1bb8c69fcfcb req-c07e7998-4e29-4065-841d-5edb77026814 service nova] Creating event network-changed:1ec35855-d3ca-49fe-8ea3-a810145ee9c8 for instance 602fd731-58b4-42fc-abe5-8428f7ff0d1d on user Apr 17 11:07:06 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-26ab6f86-fbd6-4e73-9bb2-1bb8c69fcfcb req-c07e7998-4e29-4065-841d-5edb77026814 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036870 Apr 17 11:07:06 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 336/1000] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:07:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:07:06 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Going to try to terminate instance {{(pid=72744) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 11:07:06 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-bfe16af9-06c9-47b2-b2ca-153b24030703 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/602fd731-58b4-42fc-abe5-8428f7ff0d1d" status: 204 len: 0 microversion: 2.1 time: 0.118719 Apr 17 11:07:06 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 323/1001] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 11:07:06 2023] DELETE /compute/v2.1/servers/602fd731-58b4-42fc-abe5-8428f7ff0d1d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 11:07:06 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-1577a7f1-2e3c-4583-a369-8ca7fd15c0a6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:07:06 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-1577a7f1-2e3c-4583-a369-8ca7fd15c0a6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:07:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1577a7f1-2e3c-4583-a369-8ca7fd15c0a6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:07:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1577a7f1-2e3c-4583-a369-8ca7fd15c0a6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:07:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1577a7f1-2e3c-4583-a369-8ca7fd15c0a6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:07:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1577a7f1-2e3c-4583-a369-8ca7fd15c0a6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:07:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1577a7f1-2e3c-4583-a369-8ca7fd15c0a6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:07:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1577a7f1-2e3c-4583-a369-8ca7fd15c0a6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:07:06 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-1577a7f1-2e3c-4583-a369-8ca7fd15c0a6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4ed1192974484bba2d4392f4d011c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc3b8e3925847d48b522206a8875d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:07:06 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-1577a7f1-2e3c-4583-a369-8ca7fd15c0a6 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/602fd731-58b4-42fc-abe5-8428f7ff0d1d" status: 200 len: 1565 microversion: 2.1 time: 0.250933 Apr 17 11:07:06 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 343/1002] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:07:06 2023] GET /compute/v2.1/servers/602fd731-58b4-42fc-abe5-8428f7ff0d1d => generated 1565 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 17 11:07:07 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-8470f04d-c34d-486a-b659-9bbde7532aff req-7ce099ba-a7e5-42d0-968d-c5f1251c31fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "602fd731-58b4-42fc-abe5-8428f7ff0d1d", "name": "network-vif-unplugged", "status": "completed", "tag": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:07:07 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-8470f04d-c34d-486a-b659-9bbde7532aff req-7ce099ba-a7e5-42d0-968d-c5f1251c31fc service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:07:07 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-8470f04d-c34d-486a-b659-9bbde7532aff req-7ce099ba-a7e5-42d0-968d-c5f1251c31fc service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:07:07 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-8470f04d-c34d-486a-b659-9bbde7532aff req-7ce099ba-a7e5-42d0-968d-c5f1251c31fc service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:07:07 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-8470f04d-c34d-486a-b659-9bbde7532aff req-7ce099ba-a7e5-42d0-968d-c5f1251c31fc service nova] Creating event network-vif-unplugged:1ec35855-d3ca-49fe-8ea3-a810145ee9c8 for instance 602fd731-58b4-42fc-abe5-8428f7ff0d1d on user Apr 17 11:07:07 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-8470f04d-c34d-486a-b659-9bbde7532aff req-7ce099ba-a7e5-42d0-968d-c5f1251c31fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074013 Apr 17 11:07:07 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 337/1003] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:07:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:07:09 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-5aebc51d-d506-40c2-a1a7-65610e6222f2 req-770f73b1-ec0a-4ce9-ba4b-b7344de2c076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "602fd731-58b4-42fc-abe5-8428f7ff0d1d", "name": "network-vif-plugged", "status": "completed", "tag": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8"}, {"server_uuid": "602fd731-58b4-42fc-abe5-8428f7ff0d1d", "name": "network-vif-deleted", "tag": "1ec35855-d3ca-49fe-8ea3-a810145ee9c8"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:07:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-5aebc51d-d506-40c2-a1a7-65610e6222f2 req-770f73b1-ec0a-4ce9-ba4b-b7344de2c076 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:07:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-5aebc51d-d506-40c2-a1a7-65610e6222f2 req-770f73b1-ec0a-4ce9-ba4b-b7344de2c076 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:07:09 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-5aebc51d-d506-40c2-a1a7-65610e6222f2 req-770f73b1-ec0a-4ce9-ba4b-b7344de2c076 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:07:09 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-5aebc51d-d506-40c2-a1a7-65610e6222f2 req-770f73b1-ec0a-4ce9-ba4b-b7344de2c076 service nova] Creating event network-vif-plugged:1ec35855-d3ca-49fe-8ea3-a810145ee9c8 for instance 602fd731-58b4-42fc-abe5-8428f7ff0d1d on user Apr 17 11:07:09 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-5aebc51d-d506-40c2-a1a7-65610e6222f2 req-770f73b1-ec0a-4ce9-ba4b-b7344de2c076 service nova] Creating event network-vif-deleted:1ec35855-d3ca-49fe-8ea3-a810145ee9c8 for instance 602fd731-58b4-42fc-abe5-8428f7ff0d1d on user Apr 17 11:07:09 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-5aebc51d-d506-40c2-a1a7-65610e6222f2 req-770f73b1-ec0a-4ce9-ba4b-b7344de2c076 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031330 Apr 17 11:07:09 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 324/1004] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:07:09 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:07:19 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=4 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:07:19 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=8 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:07:19 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-48221c02-c711-424e-a049-d51eb26921be tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:07:19 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-48221c02-c711-424e-a049-d51eb26921be tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:07:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-48221c02-c711-424e-a049-d51eb26921be tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:07:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-48221c02-c711-424e-a049-d51eb26921be tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:07:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-48221c02-c711-424e-a049-d51eb26921be tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:07:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-48221c02-c711-424e-a049-d51eb26921be tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:07:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-48221c02-c711-424e-a049-d51eb26921be tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:07:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-48221c02-c711-424e-a049-d51eb26921be tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:07:20 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-48221c02-c711-424e-a049-d51eb26921be tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:07:20 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-48221c02-c711-424e-a049-d51eb26921be tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" status: 200 len: 1545 microversion: 2.1 time: 0.327432 Apr 17 11:07:20 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 344/1005] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:07:19 2023] GET /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e => generated 1545 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:07:20 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-82f68a9f-488c-46ed-84b5-2931e2306013 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:07:20 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-82f68a9f-488c-46ed-84b5-2931e2306013 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:07:20 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=4 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:07:20 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=4 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:07:20 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-82f68a9f-488c-46ed-84b5-2931e2306013 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:07:20 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-82f68a9f-488c-46ed-84b5-2931e2306013 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:07:20 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-82f68a9f-488c-46ed-84b5-2931e2306013 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:07:20 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-82f68a9f-488c-46ed-84b5-2931e2306013 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:07:20 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-82f68a9f-488c-46ed-84b5-2931e2306013 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:07:20 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-82f68a9f-488c-46ed-84b5-2931e2306013 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:07:20 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-82f68a9f-488c-46ed-84b5-2931e2306013 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "POST /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e/action" status: 200 len: 28409 microversion: 2.1 time: 0.222066 Apr 17 11:07:20 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 338/1006] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 11:07:20 2023] POST /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e/action => generated 28409 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 11:07:20 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:07:20 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:07:20 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-293dd563-ed32-4caf-87f6-f33b4e71ff98 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:07:20 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-293dd563-ed32-4caf-87f6-f33b4e71ff98 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:07:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-293dd563-ed32-4caf-87f6-f33b4e71ff98 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:07:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-293dd563-ed32-4caf-87f6-f33b4e71ff98 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:07:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-293dd563-ed32-4caf-87f6-f33b4e71ff98 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:07:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-293dd563-ed32-4caf-87f6-f33b4e71ff98 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:07:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-293dd563-ed32-4caf-87f6-f33b4e71ff98 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:07:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-293dd563-ed32-4caf-87f6-f33b4e71ff98 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:07:20 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-293dd563-ed32-4caf-87f6-f33b4e71ff98 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:07:20 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-293dd563-ed32-4caf-87f6-f33b4e71ff98 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3e25766f-ccf8-435e-9d56-1f371d52bbcf" status: 200 len: 1537 microversion: 2.1 time: 0.239446 Apr 17 11:07:20 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 325/1007] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:07:20 2023] GET /compute/v2.1/servers/3e25766f-ccf8-435e-9d56-1f371d52bbcf => generated 1537 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:07:22 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-63da0284-b3b6-4c52-90e1-a1871dd69935 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:07:22 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-63da0284-b3b6-4c52-90e1-a1871dd69935 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:07:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-63da0284-b3b6-4c52-90e1-a1871dd69935 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:07:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-63da0284-b3b6-4c52-90e1-a1871dd69935 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:07:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-63da0284-b3b6-4c52-90e1-a1871dd69935 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:07:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-63da0284-b3b6-4c52-90e1-a1871dd69935 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:07:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-63da0284-b3b6-4c52-90e1-a1871dd69935 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:07:22 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-63da0284-b3b6-4c52-90e1-a1871dd69935 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:07:22 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-63da0284-b3b6-4c52-90e1-a1871dd69935 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c15ce534a649ae8a971b33221e2500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747b7d3c6844772b0e6eed5299053ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:07:22 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-63da0284-b3b6-4c52-90e1-a1871dd69935 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" status: 200 len: 1703 microversion: 2.1 time: 0.304892 Apr 17 11:07:22 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 345/1008] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:07:22 2023] GET /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 => generated 1703 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:07:56 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-8b60e814-f827-49cb-bb78-e7bf538e60c3 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:07:56 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-8b60e814-f827-49cb-bb78-e7bf538e60c3 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 602fd731-58b4-42fc-abe5-8428f7ff0d1d] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:07:56 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:07:56 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=4 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:07:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8b60e814-f827-49cb-bb78-e7bf538e60c3 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:07:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8b60e814-f827-49cb-bb78-e7bf538e60c3 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:07:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8b60e814-f827-49cb-bb78-e7bf538e60c3 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:07:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8b60e814-f827-49cb-bb78-e7bf538e60c3 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:07:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8b60e814-f827-49cb-bb78-e7bf538e60c3 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:07:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-8b60e814-f827-49cb-bb78-e7bf538e60c3 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:07:56 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-8b60e814-f827-49cb-bb78-e7bf538e60c3 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] HTTP exception thrown: Instance 602fd731-58b4-42fc-abe5-8428f7ff0d1d could not be found. Apr 17 11:07:56 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-8b60e814-f827-49cb-bb78-e7bf538e60c3 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Request method failure captured: Apr 17 11:07:56 user devstack@n-api.service[72743]: request: GET /compute/v2.1/servers/602fd731-58b4-42fc-abe5-8428f7ff0d1d HTTP/1.1 Apr 17 11:07:56 user devstack@n-api.service[72743]: Accept: application/json Apr 17 11:07:56 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 11:07:56 user devstack@n-api.service[72743]: Connection: close Apr 17 11:07:56 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 11:07:56 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 11:07:56 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 11:07:56 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 11:07:56 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 11:07:56 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSSCVaY1iKFmkIuE91AAZWbZr-St_d2GFFrNXSeGSoQiDrm-J9xeGchCURDcBT2f6OJKR7j1O2xqpvL6Q1v7RUTS6S0coDZzk4yo8dpwf8dH_RMLU-Nova4o6mAYcBGkp1ZyRONF4za9zTxaNNTE8dZP8s8iS--XIiCu-N56JXP7Shg Apr 17 11:07:56 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 11:07:56 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 11:07:56 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 11:07:56 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 11:07:56 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 11:07:56 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 11:07:56 user devstack@n-api.service[72743]: X-Project-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 11:07:56 user devstack@n-api.service[72743]: X-Project-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 11:07:56 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 11:07:56 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 11:07:56 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:07:56 user devstack@n-api.service[72743]: X-Tenant: tempest-TestVolumeBootPattern-1777404437 Apr 17 11:07:56 user devstack@n-api.service[72743]: X-Tenant-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 11:07:56 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 11:07:56 user devstack@n-api.service[72743]: X-User: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 11:07:56 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 11:07:56 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 11:07:56 user devstack@n-api.service[72743]: X-User-Id: 0e4ed1192974484bba2d4392f4d011c2 Apr 17 11:07:56 user devstack@n-api.service[72743]: X-User-Name: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 11:07:56 user devstack@n-api.service[72743]: method: > Apr 17 11:07:56 user devstack@n-api.service[72743]: exception: Instance 602fd731-58b4-42fc-abe5-8428f7ff0d1d could not be found. Apr 17 11:07:56 user devstack@n-api.service[72743]: action_args: {'id': '602fd731-58b4-42fc-abe5-8428f7ff0d1d'} Apr 17 11:07:56 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 602fd731-58b4-42fc-abe5-8428f7ff0d1d could not be found. Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 602fd731-58b4-42fc-abe5-8428f7ff0d1d could not be found. Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 602fd731-58b4-42fc-abe5-8428f7ff0d1d could not be found. Apr 17 11:07:56 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:07:56 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-8b60e814-f827-49cb-bb78-e7bf538e60c3 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Returning 404 to user: Instance 602fd731-58b4-42fc-abe5-8428f7ff0d1d could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:07:56 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-8b60e814-f827-49cb-bb78-e7bf538e60c3 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/602fd731-58b4-42fc-abe5-8428f7ff0d1d" status: 404 len: 111 microversion: 2.1 time: 0.042667 Apr 17 11:07:56 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 339/1009] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:07:56 2023] GET /compute/v2.1/servers/602fd731-58b4-42fc-abe5-8428f7ff0d1d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 11:07:57 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-cce08766-1acd-47c8-86ad-4e097d1eeeca tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:07:57 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-cce08766-1acd-47c8-86ad-4e097d1eeeca tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:07:57 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:07:57 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:07:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cce08766-1acd-47c8-86ad-4e097d1eeeca tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:07:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cce08766-1acd-47c8-86ad-4e097d1eeeca tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:07:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cce08766-1acd-47c8-86ad-4e097d1eeeca tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:07:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cce08766-1acd-47c8-86ad-4e097d1eeeca tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:07:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cce08766-1acd-47c8-86ad-4e097d1eeeca tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:07:57 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-cce08766-1acd-47c8-86ad-4e097d1eeeca tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:07:57 user devstack@n-api.service[72744]: INFO nova.api.openstack.wsgi [None req-cce08766-1acd-47c8-86ad-4e097d1eeeca tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] HTTP exception thrown: Instance 5ce6b406-b4f0-4b35-8925-b0a06e637775 could not be found. Apr 17 11:07:57 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-cce08766-1acd-47c8-86ad-4e097d1eeeca tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Request method failure captured: Apr 17 11:07:57 user devstack@n-api.service[72744]: request: DELETE /compute/v2.1/servers/5ce6b406-b4f0-4b35-8925-b0a06e637775 HTTP/1.1 Apr 17 11:07:57 user devstack@n-api.service[72744]: Accept: application/json Apr 17 11:07:57 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 11:07:57 user devstack@n-api.service[72744]: Connection: close Apr 17 11:07:57 user devstack@n-api.service[72744]: Content-Length: 0 Apr 17 11:07:57 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 11:07:57 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 11:07:57 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 11:07:57 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 11:07:57 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSSCVaY1iKFmkIuE91AAZWbZr-St_d2GFFrNXSeGSoQiDrm-J9xeGchCURDcBT2f6OJKR7j1O2xqpvL6Q1v7RUTS6S0coDZzk4yo8dpwf8dH_RMLU-Nova4o6mAYcBGkp1ZyRONF4za9zTxaNNTE8dZP8s8iS--XIiCu-N56JXP7Shg Apr 17 11:07:57 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 11:07:57 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 11:07:57 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 11:07:57 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 11:07:57 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 11:07:57 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 11:07:57 user devstack@n-api.service[72744]: X-Project-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 11:07:57 user devstack@n-api.service[72744]: X-Project-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 11:07:57 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 11:07:57 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 11:07:57 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:07:57 user devstack@n-api.service[72744]: X-Tenant: tempest-TestVolumeBootPattern-1777404437 Apr 17 11:07:57 user devstack@n-api.service[72744]: X-Tenant-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 11:07:57 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 11:07:57 user devstack@n-api.service[72744]: X-User: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 11:07:57 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 11:07:57 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 11:07:57 user devstack@n-api.service[72744]: X-User-Id: 0e4ed1192974484bba2d4392f4d011c2 Apr 17 11:07:57 user devstack@n-api.service[72744]: X-User-Name: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 11:07:57 user devstack@n-api.service[72744]: method: > Apr 17 11:07:57 user devstack@n-api.service[72744]: exception: Instance 5ce6b406-b4f0-4b35-8925-b0a06e637775 could not be found. Apr 17 11:07:57 user devstack@n-api.service[72744]: action_args: {'id': '5ce6b406-b4f0-4b35-8925-b0a06e637775'} Apr 17 11:07:57 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ce6b406-b4f0-4b35-8925-b0a06e637775 could not be found. Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ce6b406-b4f0-4b35-8925-b0a06e637775 could not be found. Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ce6b406-b4f0-4b35-8925-b0a06e637775 could not be found. Apr 17 11:07:57 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:07:57 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-cce08766-1acd-47c8-86ad-4e097d1eeeca tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Returning 404 to user: Instance 5ce6b406-b4f0-4b35-8925-b0a06e637775 could not be found. {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:07:57 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-cce08766-1acd-47c8-86ad-4e097d1eeeca tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5ce6b406-b4f0-4b35-8925-b0a06e637775" status: 404 len: 111 microversion: 2.1 time: 0.070319 Apr 17 11:07:57 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 326/1010] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 11:07:57 2023] DELETE /compute/v2.1/servers/5ce6b406-b4f0-4b35-8925-b0a06e637775 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 11:07:57 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-b78ead5e-0d07-486a-955c-7d94d5e1cdb0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:07:57 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-b78ead5e-0d07-486a-955c-7d94d5e1cdb0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] [instance: 5ce6b406-b4f0-4b35-8925-b0a06e637775] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:07:57 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=4 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:07:57 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=12 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:07:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b78ead5e-0d07-486a-955c-7d94d5e1cdb0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:07:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b78ead5e-0d07-486a-955c-7d94d5e1cdb0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:07:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b78ead5e-0d07-486a-955c-7d94d5e1cdb0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:07:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b78ead5e-0d07-486a-955c-7d94d5e1cdb0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:07:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b78ead5e-0d07-486a-955c-7d94d5e1cdb0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:07:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b78ead5e-0d07-486a-955c-7d94d5e1cdb0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:07:57 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-b78ead5e-0d07-486a-955c-7d94d5e1cdb0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] HTTP exception thrown: Instance 5ce6b406-b4f0-4b35-8925-b0a06e637775 could not be found. Apr 17 11:07:57 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-b78ead5e-0d07-486a-955c-7d94d5e1cdb0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Request method failure captured: Apr 17 11:07:57 user devstack@n-api.service[72745]: request: GET /compute/v2.1/servers/5ce6b406-b4f0-4b35-8925-b0a06e637775 HTTP/1.1 Apr 17 11:07:57 user devstack@n-api.service[72745]: Accept: application/json Apr 17 11:07:57 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 11:07:57 user devstack@n-api.service[72745]: Connection: close Apr 17 11:07:57 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 11:07:57 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 11:07:57 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 11:07:57 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 11:07:57 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 11:07:57 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSSCVaY1iKFmkIuE91AAZWbZr-St_d2GFFrNXSeGSoQiDrm-J9xeGchCURDcBT2f6OJKR7j1O2xqpvL6Q1v7RUTS6S0coDZzk4yo8dpwf8dH_RMLU-Nova4o6mAYcBGkp1ZyRONF4za9zTxaNNTE8dZP8s8iS--XIiCu-N56JXP7Shg Apr 17 11:07:57 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 11:07:57 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 11:07:57 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 11:07:57 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 11:07:57 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 11:07:57 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 11:07:57 user devstack@n-api.service[72745]: X-Project-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 11:07:57 user devstack@n-api.service[72745]: X-Project-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 11:07:57 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 11:07:57 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 11:07:57 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4fc3b8e3925847d48b522206a8875d3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:07:57 user devstack@n-api.service[72745]: X-Tenant: tempest-TestVolumeBootPattern-1777404437 Apr 17 11:07:57 user devstack@n-api.service[72745]: X-Tenant-Id: 4fc3b8e3925847d48b522206a8875d3f Apr 17 11:07:57 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-TestVolumeBootPattern-1777404437 Apr 17 11:07:57 user devstack@n-api.service[72745]: X-User: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 11:07:57 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 11:07:57 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 11:07:57 user devstack@n-api.service[72745]: X-User-Id: 0e4ed1192974484bba2d4392f4d011c2 Apr 17 11:07:57 user devstack@n-api.service[72745]: X-User-Name: tempest-TestVolumeBootPattern-1777404437-project-member Apr 17 11:07:57 user devstack@n-api.service[72745]: method: > Apr 17 11:07:57 user devstack@n-api.service[72745]: exception: Instance 5ce6b406-b4f0-4b35-8925-b0a06e637775 could not be found. Apr 17 11:07:57 user devstack@n-api.service[72745]: action_args: {'id': '5ce6b406-b4f0-4b35-8925-b0a06e637775'} Apr 17 11:07:57 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ce6b406-b4f0-4b35-8925-b0a06e637775 could not be found. Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ce6b406-b4f0-4b35-8925-b0a06e637775 could not be found. Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ce6b406-b4f0-4b35-8925-b0a06e637775 could not be found. Apr 17 11:07:57 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:07:57 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-b78ead5e-0d07-486a-955c-7d94d5e1cdb0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Returning 404 to user: Instance 5ce6b406-b4f0-4b35-8925-b0a06e637775 could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:07:57 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-b78ead5e-0d07-486a-955c-7d94d5e1cdb0 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ce6b406-b4f0-4b35-8925-b0a06e637775" status: 404 len: 111 microversion: 2.1 time: 0.036405 Apr 17 11:07:57 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 346/1011] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:07:57 2023] GET /compute/v2.1/servers/5ce6b406-b4f0-4b35-8925-b0a06e637775 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 11:08:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-ad26ffd7-b421-4696-a01f-7d8d1c35e132 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] Calling method '.version_select at 0x7fc55aa3b640>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:08:01 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-ad26ffd7-b421-4696-a01f-7d8d1c35e132 tempest-TestVolumeBootPattern-1777404437 tempest-TestVolumeBootPattern-1777404437-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-44084031" status: 202 len: 0 microversion: 2.1 time: 0.028766 Apr 17 11:08:01 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 340/1012] 10.0.0.210 () {62 vars in 1334 bytes} [Mon Apr 17 11:08:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-44084031 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 11:08:20 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:08:20 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:08:20 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:08:20 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:08:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:08:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:08:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:08:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:08:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:08:20 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:08:20 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Going to try to terminate instance {{(pid=72744) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 11:08:20 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-52df785e-9288-4066-bdc6-1fe602c2afbf tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" status: 204 len: 0 microversion: 2.1 time: 0.222570 Apr 17 11:08:20 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 327/1013] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 11:08:20 2023] DELETE /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 11:08:20 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-b8c35279-6b7d-44ce-a37e-f9e030b0c0e9 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:08:20 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-b8c35279-6b7d-44ce-a37e-f9e030b0c0e9 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:08:20 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:08:20 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:08:20 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b8c35279-6b7d-44ce-a37e-f9e030b0c0e9 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:08:20 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b8c35279-6b7d-44ce-a37e-f9e030b0c0e9 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:08:20 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b8c35279-6b7d-44ce-a37e-f9e030b0c0e9 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:08:20 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b8c35279-6b7d-44ce-a37e-f9e030b0c0e9 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:08:20 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b8c35279-6b7d-44ce-a37e-f9e030b0c0e9 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:08:20 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-b8c35279-6b7d-44ce-a37e-f9e030b0c0e9 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:08:21 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-92205533-de96-4050-9d99-ec70e212a2e8 req-7e8dbdca-e095-44d4-913c-81c2aefd9ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e", "name": "network-vif-unplugged", "status": "completed", "tag": "2ddba1ca-b737-4b90-9348-3f302831a57f"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:08:21 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:08:21 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:08:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-92205533-de96-4050-9d99-ec70e212a2e8 req-7e8dbdca-e095-44d4-913c-81c2aefd9ab2 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:08:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-92205533-de96-4050-9d99-ec70e212a2e8 req-7e8dbdca-e095-44d4-913c-81c2aefd9ab2 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:08:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-92205533-de96-4050-9d99-ec70e212a2e8 req-7e8dbdca-e095-44d4-913c-81c2aefd9ab2 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:08:21 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-b8c35279-6b7d-44ce-a37e-f9e030b0c0e9 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:08:21 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-92205533-de96-4050-9d99-ec70e212a2e8 req-7e8dbdca-e095-44d4-913c-81c2aefd9ab2 service nova] Creating event network-vif-unplugged:2ddba1ca-b737-4b90-9348-3f302831a57f for instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e on user Apr 17 11:08:21 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-b8c35279-6b7d-44ce-a37e-f9e030b0c0e9 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" status: 200 len: 1551 microversion: 2.1 time: 0.251884 Apr 17 11:08:21 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 347/1014] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:08:20 2023] GET /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e => generated 1551 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:08:21 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-92205533-de96-4050-9d99-ec70e212a2e8 req-7e8dbdca-e095-44d4-913c-81c2aefd9ab2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046607 Apr 17 11:08:21 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 341/1015] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:08:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:08:23 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-01e6ac72-0d6d-4ebc-ac4b-34420192d7c9 req-6de120c2-16c3-4e13-944b-5eaf8115674d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e", "name": "network-vif-plugged", "status": "completed", "tag": "2ddba1ca-b737-4b90-9348-3f302831a57f"}, {"server_uuid": "95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e", "name": "network-vif-deleted", "tag": "2ddba1ca-b737-4b90-9348-3f302831a57f"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:08:23 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-01e6ac72-0d6d-4ebc-ac4b-34420192d7c9 req-6de120c2-16c3-4e13-944b-5eaf8115674d service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:08:23 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-01e6ac72-0d6d-4ebc-ac4b-34420192d7c9 req-6de120c2-16c3-4e13-944b-5eaf8115674d service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:08:23 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-01e6ac72-0d6d-4ebc-ac4b-34420192d7c9 req-6de120c2-16c3-4e13-944b-5eaf8115674d service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:08:23 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-640b0385-d93b-405c-93d6-cd6a6b27cb7c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:08:23 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-640b0385-d93b-405c-93d6-cd6a6b27cb7c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:08:23 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-01e6ac72-0d6d-4ebc-ac4b-34420192d7c9 req-6de120c2-16c3-4e13-944b-5eaf8115674d service nova] Creating event network-vif-plugged:2ddba1ca-b737-4b90-9348-3f302831a57f for instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e on user Apr 17 11:08:23 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-01e6ac72-0d6d-4ebc-ac4b-34420192d7c9 req-6de120c2-16c3-4e13-944b-5eaf8115674d service nova] Creating event network-vif-deleted:2ddba1ca-b737-4b90-9348-3f302831a57f for instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e on user Apr 17 11:08:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-640b0385-d93b-405c-93d6-cd6a6b27cb7c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:08:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-640b0385-d93b-405c-93d6-cd6a6b27cb7c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:08:23 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-01e6ac72-0d6d-4ebc-ac4b-34420192d7c9 req-6de120c2-16c3-4e13-944b-5eaf8115674d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041642 Apr 17 11:08:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-640b0385-d93b-405c-93d6-cd6a6b27cb7c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:08:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-640b0385-d93b-405c-93d6-cd6a6b27cb7c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:08:23 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 328/1016] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:08:23 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:08:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-640b0385-d93b-405c-93d6-cd6a6b27cb7c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:08:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-640b0385-d93b-405c-93d6-cd6a6b27cb7c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:08:23 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-640b0385-d93b-405c-93d6-cd6a6b27cb7c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] HTTP exception thrown: Cannot 'detach_volume' instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 while it is in vm_state rescued Apr 17 11:08:23 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-640b0385-d93b-405c-93d6-cd6a6b27cb7c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Request method failure captured: Apr 17 11:08:23 user devstack@n-api.service[72745]: request: DELETE /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/os-volume_attachments/9884dc01-fc15-48b8-935e-eef5420d68b1 HTTP/1.1 Apr 17 11:08:23 user devstack@n-api.service[72745]: Accept: application/json Apr 17 11:08:23 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 11:08:23 user devstack@n-api.service[72745]: Connection: close Apr 17 11:08:23 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 11:08:23 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 11:08:23 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 11:08:23 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 11:08:23 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 11:08:23 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSW-MrZeODEec0-GgKUVgcRRo9sR4IeW6R89M43QejliWYRYWbCdjzy6wRMS_cGtnxUrDzja9_DSrU_6Fw-WleIpEonGoJmFRMs8ds6cyemfdZByXsb2oi00E8GmlY0wlg6_XxhRgCWsYq5BBZzlT8hJjqZ7UMV7PuzjMaKmHClTbJ4 Apr 17 11:08:23 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 11:08:23 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 11:08:23 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 11:08:23 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 11:08:23 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 11:08:23 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 11:08:23 user devstack@n-api.service[72745]: X-Project-Id: 3747b7d3c6844772b0e6eed5299053ba Apr 17 11:08:23 user devstack@n-api.service[72745]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1988041396 Apr 17 11:08:23 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 11:08:23 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 11:08:23 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3747b7d3c6844772b0e6eed5299053ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3747b7d3c6844772b0e6eed5299053ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3747b7d3c6844772b0e6eed5299053ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:08:23 user devstack@n-api.service[72745]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1988041396 Apr 17 11:08:23 user devstack@n-api.service[72745]: X-Tenant-Id: 3747b7d3c6844772b0e6eed5299053ba Apr 17 11:08:23 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1988041396 Apr 17 11:08:23 user devstack@n-api.service[72745]: X-User: tempest-ServerRescueNegativeTestJSON-1988041396-project-member Apr 17 11:08:23 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 11:08:23 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 11:08:23 user devstack@n-api.service[72745]: X-User-Id: 30c15ce534a649ae8a971b33221e2500 Apr 17 11:08:23 user devstack@n-api.service[72745]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1988041396-project-member Apr 17 11:08:23 user devstack@n-api.service[72745]: method: > Apr 17 11:08:23 user devstack@n-api.service[72745]: exception: Cannot 'detach_volume' instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 while it is in vm_state rescued Apr 17 11:08:23 user devstack@n-api.service[72745]: action_args: {'server_id': 'd3ee5567-1a2d-4db4-8519-ba4308d8d3b6', 'id': '9884dc01-fc15-48b8-935e-eef5420d68b1'} Apr 17 11:08:23 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 while it is in vm_state rescued Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 while it is in vm_state rescued Apr 17 11:08:23 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:08:23 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-640b0385-d93b-405c-93d6-cd6a6b27cb7c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Returning 409 to user: Cannot 'detach_volume' instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 while it is in vm_state rescued {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:08:23 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-640b0385-d93b-405c-93d6-cd6a6b27cb7c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/os-volume_attachments/9884dc01-fc15-48b8-935e-eef5420d68b1" status: 409 len: 152 microversion: 2.1 time: 0.109244 Apr 17 11:08:23 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 348/1017] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Apr 17 11:08:23 2023] DELETE /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/os-volume_attachments/9884dc01-fc15-48b8-935e-eef5420d68b1 => generated 152 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 17 11:08:23 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-798a5b94-cf24-43cd-9549-c0608e97f320 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:08:23 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-798a5b94-cf24-43cd-9549-c0608e97f320 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:08:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-798a5b94-cf24-43cd-9549-c0608e97f320 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:08:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-798a5b94-cf24-43cd-9549-c0608e97f320 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:08:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-798a5b94-cf24-43cd-9549-c0608e97f320 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:08:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-798a5b94-cf24-43cd-9549-c0608e97f320 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:08:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-798a5b94-cf24-43cd-9549-c0608e97f320 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:08:23 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-798a5b94-cf24-43cd-9549-c0608e97f320 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:08:23 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-798a5b94-cf24-43cd-9549-c0608e97f320 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/action" status: 202 len: 0 microversion: 2.1 time: 0.078913 Apr 17 11:08:23 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 342/1018] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 11:08:23 2023] POST /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 11:08:23 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-9bea76c9-4e95-4e7b-8871-b5617342533d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:08:23 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-9bea76c9-4e95-4e7b-8871-b5617342533d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:08:23 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-9bea76c9-4e95-4e7b-8871-b5617342533d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:08:23 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-9bea76c9-4e95-4e7b-8871-b5617342533d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:08:23 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-9bea76c9-4e95-4e7b-8871-b5617342533d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:08:23 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-9bea76c9-4e95-4e7b-8871-b5617342533d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:08:23 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-9bea76c9-4e95-4e7b-8871-b5617342533d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:08:23 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-9bea76c9-4e95-4e7b-8871-b5617342533d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:08:23 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-9bea76c9-4e95-4e7b-8871-b5617342533d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c15ce534a649ae8a971b33221e2500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747b7d3c6844772b0e6eed5299053ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:08:23 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-9bea76c9-4e95-4e7b-8871-b5617342533d tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" status: 200 len: 1711 microversion: 2.1 time: 0.421520 Apr 17 11:08:23 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 329/1019] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:08:23 2023] GET /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 => generated 1711 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:08:24 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-c7332cbb-a981-4f41-9da3-ae13f87e92de req-fed36b5f-e3f6-4424-95a6-f49ec16e4d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6", "name": "network-vif-unplugged", "status": "completed", "tag": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:08:24 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-c7332cbb-a981-4f41-9da3-ae13f87e92de req-fed36b5f-e3f6-4424-95a6-f49ec16e4d99 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:08:24 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-c7332cbb-a981-4f41-9da3-ae13f87e92de req-fed36b5f-e3f6-4424-95a6-f49ec16e4d99 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:08:24 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-c7332cbb-a981-4f41-9da3-ae13f87e92de req-fed36b5f-e3f6-4424-95a6-f49ec16e4d99 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:08:24 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-c7332cbb-a981-4f41-9da3-ae13f87e92de req-fed36b5f-e3f6-4424-95a6-f49ec16e4d99 service nova] Creating event network-vif-unplugged:bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 on user Apr 17 11:08:24 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-c7332cbb-a981-4f41-9da3-ae13f87e92de req-fed36b5f-e3f6-4424-95a6-f49ec16e4d99 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154950 Apr 17 11:08:24 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 349/1020] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:08:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 11:08:26 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-588ed3f0-5fda-4e16-be13-c9d945dd6470 req-5cc810fe-f154-4ed7-b9f3-8565519c0229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6", "name": "network-vif-plugged", "status": "completed", "tag": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4"}, {"server_uuid": "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6", "name": "network-vif-plugged", "status": "completed", "tag": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:08:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-588ed3f0-5fda-4e16-be13-c9d945dd6470 req-5cc810fe-f154-4ed7-b9f3-8565519c0229 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:08:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-588ed3f0-5fda-4e16-be13-c9d945dd6470 req-5cc810fe-f154-4ed7-b9f3-8565519c0229 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:08:26 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-588ed3f0-5fda-4e16-be13-c9d945dd6470 req-5cc810fe-f154-4ed7-b9f3-8565519c0229 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:08:26 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-588ed3f0-5fda-4e16-be13-c9d945dd6470 req-5cc810fe-f154-4ed7-b9f3-8565519c0229 service nova] Creating event network-vif-plugged:bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 on user Apr 17 11:08:26 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-588ed3f0-5fda-4e16-be13-c9d945dd6470 req-5cc810fe-f154-4ed7-b9f3-8565519c0229 service nova] Creating event network-vif-plugged:bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 on user Apr 17 11:08:26 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-588ed3f0-5fda-4e16-be13-c9d945dd6470 req-5cc810fe-f154-4ed7-b9f3-8565519c0229 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048643 Apr 17 11:08:26 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 343/1021] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:08:26 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:08:28 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-9d74d1a2-de6b-49d2-91d2-f3b08ddef80f req-00f687e3-922b-42fe-847a-9810a9eedb0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6", "name": "network-vif-plugged", "status": "completed", "tag": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:08:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-9d74d1a2-de6b-49d2-91d2-f3b08ddef80f req-00f687e3-922b-42fe-847a-9810a9eedb0b service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:08:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-9d74d1a2-de6b-49d2-91d2-f3b08ddef80f req-00f687e3-922b-42fe-847a-9810a9eedb0b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:08:28 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-9d74d1a2-de6b-49d2-91d2-f3b08ddef80f req-00f687e3-922b-42fe-847a-9810a9eedb0b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:08:28 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-9d74d1a2-de6b-49d2-91d2-f3b08ddef80f req-00f687e3-922b-42fe-847a-9810a9eedb0b service nova] Creating event network-vif-plugged:bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 on user Apr 17 11:08:28 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-9d74d1a2-de6b-49d2-91d2-f3b08ddef80f req-00f687e3-922b-42fe-847a-9810a9eedb0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033086 Apr 17 11:08:28 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 330/1022] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:08:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:09:11 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:09:11 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=14 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:09:11 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-ea7d5780-0895-48c3-878c-59cef088ae26 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:09:11 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-ea7d5780-0895-48c3-878c-59cef088ae26 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:09:11 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ea7d5780-0895-48c3-878c-59cef088ae26 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:09:11 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ea7d5780-0895-48c3-878c-59cef088ae26 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:09:11 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ea7d5780-0895-48c3-878c-59cef088ae26 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:09:11 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ea7d5780-0895-48c3-878c-59cef088ae26 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:09:11 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ea7d5780-0895-48c3-878c-59cef088ae26 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:09:11 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ea7d5780-0895-48c3-878c-59cef088ae26 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:09:11 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-ea7d5780-0895-48c3-878c-59cef088ae26 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] HTTP exception thrown: Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e could not be found. Apr 17 11:09:11 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-ea7d5780-0895-48c3-878c-59cef088ae26 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Request method failure captured: Apr 17 11:09:11 user devstack@n-api.service[72745]: request: GET /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e HTTP/1.1 Apr 17 11:09:11 user devstack@n-api.service[72745]: Accept: application/json Apr 17 11:09:11 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 11:09:11 user devstack@n-api.service[72745]: Connection: close Apr 17 11:09:11 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 11:09:11 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 11:09:11 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 11:09:11 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 11:09:11 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 11:09:11 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSNDDukOA8EPGS_JB9BsvtkI9C7IEIOZRqMnIfWkrLT4xoIZaX0pcEoI0m7n5QDjj9YhnvQl9_4zK2ppURuFVv3B8rHwHUMgGTge6_4n3i8OhDt-XaWKbcEY3OMG0sXTCZ5H1g2CzMX9wwItjKWNb07Gf-LHL2aAzmNlLTXBm-ti6e8 Apr 17 11:09:11 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 11:09:11 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 11:09:11 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 11:09:11 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 11:09:11 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 11:09:11 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 11:09:11 user devstack@n-api.service[72745]: X-Project-Id: cc1b39ff9581474b87c58164e5cafa00 Apr 17 11:09:11 user devstack@n-api.service[72745]: X-Project-Name: tempest-ServerActionsTestJSON-2107442540 Apr 17 11:09:11 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 11:09:11 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 11:09:11 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc1b39ff9581474b87c58164e5cafa00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc1b39ff9581474b87c58164e5cafa00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cc1b39ff9581474b87c58164e5cafa00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:09:11 user devstack@n-api.service[72745]: X-Tenant: tempest-ServerActionsTestJSON-2107442540 Apr 17 11:09:11 user devstack@n-api.service[72745]: X-Tenant-Id: cc1b39ff9581474b87c58164e5cafa00 Apr 17 11:09:11 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-ServerActionsTestJSON-2107442540 Apr 17 11:09:11 user devstack@n-api.service[72745]: X-User: tempest-ServerActionsTestJSON-2107442540-project-member Apr 17 11:09:11 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 11:09:11 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 11:09:11 user devstack@n-api.service[72745]: X-User-Id: a7e218d771db49e88d13d3b088f3d88a Apr 17 11:09:11 user devstack@n-api.service[72745]: X-User-Name: tempest-ServerActionsTestJSON-2107442540-project-member Apr 17 11:09:11 user devstack@n-api.service[72745]: method: > Apr 17 11:09:11 user devstack@n-api.service[72745]: exception: Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e could not be found. Apr 17 11:09:11 user devstack@n-api.service[72745]: action_args: {'id': '95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e'} Apr 17 11:09:11 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e could not be found. Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e could not be found. Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e could not be found. Apr 17 11:09:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:09:11 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-ea7d5780-0895-48c3-878c-59cef088ae26 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Returning 404 to user: Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:09:11 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-ea7d5780-0895-48c3-878c-59cef088ae26 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" status: 404 len: 111 microversion: 2.1 time: 0.040078 Apr 17 11:09:11 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 350/1023] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:09:11 2023] GET /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 11:09:11 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-3da1a281-5afa-434c-88c3-00ad128276ee tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:09:11 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-3da1a281-5afa-434c-88c3-00ad128276ee tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:09:11 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:09:11 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:09:11 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3da1a281-5afa-434c-88c3-00ad128276ee tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:09:11 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3da1a281-5afa-434c-88c3-00ad128276ee tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:09:11 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3da1a281-5afa-434c-88c3-00ad128276ee tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:09:11 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3da1a281-5afa-434c-88c3-00ad128276ee tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:09:11 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3da1a281-5afa-434c-88c3-00ad128276ee tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:09:11 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3da1a281-5afa-434c-88c3-00ad128276ee tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:09:11 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-3da1a281-5afa-434c-88c3-00ad128276ee tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] HTTP exception thrown: Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e could not be found. Apr 17 11:09:11 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-3da1a281-5afa-434c-88c3-00ad128276ee tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Request method failure captured: Apr 17 11:09:11 user devstack@n-api.service[72743]: request: DELETE /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e HTTP/1.1 Apr 17 11:09:11 user devstack@n-api.service[72743]: Accept: application/json Apr 17 11:09:11 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 11:09:11 user devstack@n-api.service[72743]: Connection: close Apr 17 11:09:11 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 11:09:11 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 11:09:11 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 11:09:11 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 11:09:11 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 11:09:11 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSNDDukOA8EPGS_JB9BsvtkI9C7IEIOZRqMnIfWkrLT4xoIZaX0pcEoI0m7n5QDjj9YhnvQl9_4zK2ppURuFVv3B8rHwHUMgGTge6_4n3i8OhDt-XaWKbcEY3OMG0sXTCZ5H1g2CzMX9wwItjKWNb07Gf-LHL2aAzmNlLTXBm-ti6e8 Apr 17 11:09:11 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 11:09:11 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 11:09:11 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 11:09:11 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 11:09:11 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 11:09:11 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 11:09:11 user devstack@n-api.service[72743]: X-Project-Id: cc1b39ff9581474b87c58164e5cafa00 Apr 17 11:09:11 user devstack@n-api.service[72743]: X-Project-Name: tempest-ServerActionsTestJSON-2107442540 Apr 17 11:09:11 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 11:09:11 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 11:09:11 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc1b39ff9581474b87c58164e5cafa00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc1b39ff9581474b87c58164e5cafa00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cc1b39ff9581474b87c58164e5cafa00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:09:11 user devstack@n-api.service[72743]: X-Tenant: tempest-ServerActionsTestJSON-2107442540 Apr 17 11:09:11 user devstack@n-api.service[72743]: X-Tenant-Id: cc1b39ff9581474b87c58164e5cafa00 Apr 17 11:09:11 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-ServerActionsTestJSON-2107442540 Apr 17 11:09:11 user devstack@n-api.service[72743]: X-User: tempest-ServerActionsTestJSON-2107442540-project-member Apr 17 11:09:11 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 11:09:11 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 11:09:11 user devstack@n-api.service[72743]: X-User-Id: a7e218d771db49e88d13d3b088f3d88a Apr 17 11:09:11 user devstack@n-api.service[72743]: X-User-Name: tempest-ServerActionsTestJSON-2107442540-project-member Apr 17 11:09:11 user devstack@n-api.service[72743]: method: > Apr 17 11:09:11 user devstack@n-api.service[72743]: exception: Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e could not be found. Apr 17 11:09:11 user devstack@n-api.service[72743]: action_args: {'id': '95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e'} Apr 17 11:09:11 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e could not be found. Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e could not be found. Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e could not be found. Apr 17 11:09:11 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:09:11 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-3da1a281-5afa-434c-88c3-00ad128276ee tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Returning 404 to user: Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:09:11 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-3da1a281-5afa-434c-88c3-00ad128276ee tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" status: 404 len: 111 microversion: 2.1 time: 0.036484 Apr 17 11:09:11 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 344/1024] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 11:09:11 2023] DELETE /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 11:09:11 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:09:11 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:09:11 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-77a04cfe-511a-43ec-9879-b8671a3f0923 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:09:11 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-77a04cfe-511a-43ec-9879-b8671a3f0923 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:09:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-77a04cfe-511a-43ec-9879-b8671a3f0923 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:09:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-77a04cfe-511a-43ec-9879-b8671a3f0923 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:09:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-77a04cfe-511a-43ec-9879-b8671a3f0923 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:09:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-77a04cfe-511a-43ec-9879-b8671a3f0923 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:09:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-77a04cfe-511a-43ec-9879-b8671a3f0923 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:09:11 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-77a04cfe-511a-43ec-9879-b8671a3f0923 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:09:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.wsgi [None req-77a04cfe-511a-43ec-9879-b8671a3f0923 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] HTTP exception thrown: Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e could not be found. Apr 17 11:09:11 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-77a04cfe-511a-43ec-9879-b8671a3f0923 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Request method failure captured: Apr 17 11:09:11 user devstack@n-api.service[72744]: request: GET /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e HTTP/1.1 Apr 17 11:09:11 user devstack@n-api.service[72744]: Accept: application/json Apr 17 11:09:11 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 11:09:11 user devstack@n-api.service[72744]: Connection: close Apr 17 11:09:11 user devstack@n-api.service[72744]: Content-Length: 0 Apr 17 11:09:11 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 11:09:11 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 11:09:11 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 11:09:11 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 11:09:11 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSNDDukOA8EPGS_JB9BsvtkI9C7IEIOZRqMnIfWkrLT4xoIZaX0pcEoI0m7n5QDjj9YhnvQl9_4zK2ppURuFVv3B8rHwHUMgGTge6_4n3i8OhDt-XaWKbcEY3OMG0sXTCZ5H1g2CzMX9wwItjKWNb07Gf-LHL2aAzmNlLTXBm-ti6e8 Apr 17 11:09:11 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 11:09:11 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 11:09:11 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 11:09:11 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 11:09:11 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 11:09:11 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 11:09:11 user devstack@n-api.service[72744]: X-Project-Id: cc1b39ff9581474b87c58164e5cafa00 Apr 17 11:09:11 user devstack@n-api.service[72744]: X-Project-Name: tempest-ServerActionsTestJSON-2107442540 Apr 17 11:09:11 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 11:09:11 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 11:09:11 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc1b39ff9581474b87c58164e5cafa00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc1b39ff9581474b87c58164e5cafa00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cc1b39ff9581474b87c58164e5cafa00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:09:11 user devstack@n-api.service[72744]: X-Tenant: tempest-ServerActionsTestJSON-2107442540 Apr 17 11:09:11 user devstack@n-api.service[72744]: X-Tenant-Id: cc1b39ff9581474b87c58164e5cafa00 Apr 17 11:09:11 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-ServerActionsTestJSON-2107442540 Apr 17 11:09:11 user devstack@n-api.service[72744]: X-User: tempest-ServerActionsTestJSON-2107442540-project-member Apr 17 11:09:11 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 11:09:11 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 11:09:11 user devstack@n-api.service[72744]: X-User-Id: a7e218d771db49e88d13d3b088f3d88a Apr 17 11:09:11 user devstack@n-api.service[72744]: X-User-Name: tempest-ServerActionsTestJSON-2107442540-project-member Apr 17 11:09:11 user devstack@n-api.service[72744]: method: > Apr 17 11:09:11 user devstack@n-api.service[72744]: exception: Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e could not be found. Apr 17 11:09:11 user devstack@n-api.service[72744]: action_args: {'id': '95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e'} Apr 17 11:09:11 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e could not be found. Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e could not be found. Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e could not be found. Apr 17 11:09:11 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:09:11 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-77a04cfe-511a-43ec-9879-b8671a3f0923 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Returning 404 to user: Instance 95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e could not be found. {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:09:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-77a04cfe-511a-43ec-9879-b8671a3f0923 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e" status: 404 len: 111 microversion: 2.1 time: 0.296379 Apr 17 11:09:11 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 331/1025] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:09:11 2023] GET /compute/v2.1/servers/95e4b081-4da1-4dfd-8f40-e5f5c94a4e1e => generated 111 bytes in 300 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 11:09:11 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:09:11 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:09:11 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:09:11 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:09:11 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:09:11 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:09:11 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:09:11 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:09:11 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Going to try to terminate instance {{(pid=72745) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 11:09:11 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-335622a3-e7d1-4013-9e13-f533ac410a93 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3e25766f-ccf8-435e-9d56-1f371d52bbcf" status: 204 len: 0 microversion: 2.1 time: 0.119575 Apr 17 11:09:11 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 351/1026] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 11:09:11 2023] DELETE /compute/v2.1/servers/3e25766f-ccf8-435e-9d56-1f371d52bbcf => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 11:09:11 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-3d68b452-efbb-4b71-90a5-2f15b3fe1ef3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:09:11 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-3d68b452-efbb-4b71-90a5-2f15b3fe1ef3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:09:11 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3d68b452-efbb-4b71-90a5-2f15b3fe1ef3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:09:11 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3d68b452-efbb-4b71-90a5-2f15b3fe1ef3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:09:11 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3d68b452-efbb-4b71-90a5-2f15b3fe1ef3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:09:11 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3d68b452-efbb-4b71-90a5-2f15b3fe1ef3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:09:11 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3d68b452-efbb-4b71-90a5-2f15b3fe1ef3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:09:11 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3d68b452-efbb-4b71-90a5-2f15b3fe1ef3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:09:12 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-3d68b452-efbb-4b71-90a5-2f15b3fe1ef3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e218d771db49e88d13d3b088f3d88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1b39ff9581474b87c58164e5cafa00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:09:12 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-3d68b452-efbb-4b71-90a5-2f15b3fe1ef3 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3e25766f-ccf8-435e-9d56-1f371d52bbcf" status: 200 len: 1543 microversion: 2.1 time: 0.273594 Apr 17 11:09:12 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 345/1027] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:09:11 2023] GET /compute/v2.1/servers/3e25766f-ccf8-435e-9d56-1f371d52bbcf => generated 1543 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:09:12 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-09942559-8c65-4985-8334-714494eef99c req-a550ebb3-075b-4557-bdd4-bd70f7211acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e25766f-ccf8-435e-9d56-1f371d52bbcf", "name": "network-vif-unplugged", "status": "completed", "tag": "50e629ae-2997-44f7-985a-9f0b73c8e576"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:09:12 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-09942559-8c65-4985-8334-714494eef99c req-a550ebb3-075b-4557-bdd4-bd70f7211acf service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:09:12 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-09942559-8c65-4985-8334-714494eef99c req-a550ebb3-075b-4557-bdd4-bd70f7211acf service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:09:12 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-09942559-8c65-4985-8334-714494eef99c req-a550ebb3-075b-4557-bdd4-bd70f7211acf service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:09:12 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-09942559-8c65-4985-8334-714494eef99c req-a550ebb3-075b-4557-bdd4-bd70f7211acf service nova] Creating event network-vif-unplugged:50e629ae-2997-44f7-985a-9f0b73c8e576 for instance 3e25766f-ccf8-435e-9d56-1f371d52bbcf on user Apr 17 11:09:12 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-09942559-8c65-4985-8334-714494eef99c req-a550ebb3-075b-4557-bdd4-bd70f7211acf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.254524 Apr 17 11:09:12 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 332/1028] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:09:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:09:13 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-b2ae6f75-ab17-4b13-aa25-83560a08de0b req-5e6f8fd5-2425-4b56-a714-a398c1150b3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e25766f-ccf8-435e-9d56-1f371d52bbcf", "name": "network-vif-deleted", "tag": "50e629ae-2997-44f7-985a-9f0b73c8e576"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:09:13 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-b2ae6f75-ab17-4b13-aa25-83560a08de0b req-5e6f8fd5-2425-4b56-a714-a398c1150b3e service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:09:13 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-b2ae6f75-ab17-4b13-aa25-83560a08de0b req-5e6f8fd5-2425-4b56-a714-a398c1150b3e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:09:13 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-b2ae6f75-ab17-4b13-aa25-83560a08de0b req-5e6f8fd5-2425-4b56-a714-a398c1150b3e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:09:13 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-b2ae6f75-ab17-4b13-aa25-83560a08de0b req-5e6f8fd5-2425-4b56-a714-a398c1150b3e service nova] Creating event network-vif-deleted:50e629ae-2997-44f7-985a-9f0b73c8e576 for instance 3e25766f-ccf8-435e-9d56-1f371d52bbcf on user Apr 17 11:09:13 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-b2ae6f75-ab17-4b13-aa25-83560a08de0b req-5e6f8fd5-2425-4b56-a714-a398c1150b3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028898 Apr 17 11:09:13 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 352/1029] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:09:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:09:13 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-7c48f336-8749-45cb-b13a-4e0aabff8fd2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:09:13 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-7c48f336-8749-45cb-b13a-4e0aabff8fd2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:09:13 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7c48f336-8749-45cb-b13a-4e0aabff8fd2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:09:13 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7c48f336-8749-45cb-b13a-4e0aabff8fd2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:09:13 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7c48f336-8749-45cb-b13a-4e0aabff8fd2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:09:13 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7c48f336-8749-45cb-b13a-4e0aabff8fd2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:09:13 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7c48f336-8749-45cb-b13a-4e0aabff8fd2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:09:13 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-7c48f336-8749-45cb-b13a-4e0aabff8fd2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:09:14 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-7c48f336-8749-45cb-b13a-4e0aabff8fd2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c15ce534a649ae8a971b33221e2500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747b7d3c6844772b0e6eed5299053ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:09:14 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-7c48f336-8749-45cb-b13a-4e0aabff8fd2 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" status: 200 len: 1717 microversion: 2.1 time: 0.227337 Apr 17 11:09:14 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 346/1030] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:09:13 2023] GET /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 => generated 1717 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:09:14 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-f40d6b70-b0fb-49a5-9907-13a7838632a9 req-c12e766b-2276-4537-bd81-46a270cdc9d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e25766f-ccf8-435e-9d56-1f371d52bbcf", "name": "network-vif-plugged", "status": "completed", "tag": "50e629ae-2997-44f7-985a-9f0b73c8e576"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:09:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-f40d6b70-b0fb-49a5-9907-13a7838632a9 req-c12e766b-2276-4537-bd81-46a270cdc9d5 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:09:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-f40d6b70-b0fb-49a5-9907-13a7838632a9 req-c12e766b-2276-4537-bd81-46a270cdc9d5 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:09:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-f40d6b70-b0fb-49a5-9907-13a7838632a9 req-c12e766b-2276-4537-bd81-46a270cdc9d5 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:09:14 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-f40d6b70-b0fb-49a5-9907-13a7838632a9 req-c12e766b-2276-4537-bd81-46a270cdc9d5 service nova] Creating event network-vif-plugged:50e629ae-2997-44f7-985a-9f0b73c8e576 for instance 3e25766f-ccf8-435e-9d56-1f371d52bbcf on user Apr 17 11:09:14 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-f40d6b70-b0fb-49a5-9907-13a7838632a9 req-c12e766b-2276-4537-bd81-46a270cdc9d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028269 Apr 17 11:09:14 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 333/1031] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:09:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a6512bb3-50d1-485e-9503-ae2677ff2705] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 17 11:10:02 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:10:02 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:10:02 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-3c1ba14b-c60f-4784-8cc9-5713c1514c99 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:10:02 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-3c1ba14b-c60f-4784-8cc9-5713c1514c99 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 3e25766f-ccf8-435e-9d56-1f371d52bbcf] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:10:02 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3c1ba14b-c60f-4784-8cc9-5713c1514c99 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:10:02 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3c1ba14b-c60f-4784-8cc9-5713c1514c99 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:10:02 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3c1ba14b-c60f-4784-8cc9-5713c1514c99 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:10:02 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3c1ba14b-c60f-4784-8cc9-5713c1514c99 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:10:02 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3c1ba14b-c60f-4784-8cc9-5713c1514c99 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:10:02 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-3c1ba14b-c60f-4784-8cc9-5713c1514c99 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:10:02 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-3c1ba14b-c60f-4784-8cc9-5713c1514c99 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] HTTP exception thrown: Instance 3e25766f-ccf8-435e-9d56-1f371d52bbcf could not be found. Apr 17 11:10:02 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-3c1ba14b-c60f-4784-8cc9-5713c1514c99 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Request method failure captured: Apr 17 11:10:02 user devstack@n-api.service[72745]: request: GET /compute/v2.1/servers/3e25766f-ccf8-435e-9d56-1f371d52bbcf HTTP/1.1 Apr 17 11:10:02 user devstack@n-api.service[72745]: Accept: application/json Apr 17 11:10:02 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 11:10:02 user devstack@n-api.service[72745]: Connection: close Apr 17 11:10:02 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 11:10:02 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 11:10:02 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 11:10:02 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 11:10:02 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 11:10:02 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSNDDukOA8EPGS_JB9BsvtkI9C7IEIOZRqMnIfWkrLT4xoIZaX0pcEoI0m7n5QDjj9YhnvQl9_4zK2ppURuFVv3B8rHwHUMgGTge6_4n3i8OhDt-XaWKbcEY3OMG0sXTCZ5H1g2CzMX9wwItjKWNb07Gf-LHL2aAzmNlLTXBm-ti6e8 Apr 17 11:10:02 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 11:10:02 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 11:10:02 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 11:10:02 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 11:10:02 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 11:10:02 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 11:10:02 user devstack@n-api.service[72745]: X-Project-Id: cc1b39ff9581474b87c58164e5cafa00 Apr 17 11:10:02 user devstack@n-api.service[72745]: X-Project-Name: tempest-ServerActionsTestJSON-2107442540 Apr 17 11:10:02 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 11:10:02 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 11:10:02 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc1b39ff9581474b87c58164e5cafa00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc1b39ff9581474b87c58164e5cafa00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cc1b39ff9581474b87c58164e5cafa00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:10:02 user devstack@n-api.service[72745]: X-Tenant: tempest-ServerActionsTestJSON-2107442540 Apr 17 11:10:02 user devstack@n-api.service[72745]: X-Tenant-Id: cc1b39ff9581474b87c58164e5cafa00 Apr 17 11:10:02 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-ServerActionsTestJSON-2107442540 Apr 17 11:10:02 user devstack@n-api.service[72745]: X-User: tempest-ServerActionsTestJSON-2107442540-project-member Apr 17 11:10:02 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 11:10:02 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 11:10:02 user devstack@n-api.service[72745]: X-User-Id: a7e218d771db49e88d13d3b088f3d88a Apr 17 11:10:02 user devstack@n-api.service[72745]: X-User-Name: tempest-ServerActionsTestJSON-2107442540-project-member Apr 17 11:10:02 user devstack@n-api.service[72745]: method: > Apr 17 11:10:02 user devstack@n-api.service[72745]: exception: Instance 3e25766f-ccf8-435e-9d56-1f371d52bbcf could not be found. Apr 17 11:10:02 user devstack@n-api.service[72745]: action_args: {'id': '3e25766f-ccf8-435e-9d56-1f371d52bbcf'} Apr 17 11:10:02 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e25766f-ccf8-435e-9d56-1f371d52bbcf could not be found. Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e25766f-ccf8-435e-9d56-1f371d52bbcf could not be found. Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e25766f-ccf8-435e-9d56-1f371d52bbcf could not be found. Apr 17 11:10:02 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:10:02 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-3c1ba14b-c60f-4784-8cc9-5713c1514c99 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Returning 404 to user: Instance 3e25766f-ccf8-435e-9d56-1f371d52bbcf could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:10:02 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-3c1ba14b-c60f-4784-8cc9-5713c1514c99 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3e25766f-ccf8-435e-9d56-1f371d52bbcf" status: 404 len: 111 microversion: 2.1 time: 0.038696 Apr 17 11:10:02 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 353/1032] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:10:02 2023] GET /compute/v2.1/servers/3e25766f-ccf8-435e-9d56-1f371d52bbcf => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 11:10:08 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-cb708d55-b5d4-4fe1-a1f7-b58f8a5bcdd6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:10:08 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-cb708d55-b5d4-4fe1-a1f7-b58f8a5bcdd6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:10:08 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:10:08 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=14 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:10:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-cb708d55-b5d4-4fe1-a1f7-b58f8a5bcdd6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:10:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-cb708d55-b5d4-4fe1-a1f7-b58f8a5bcdd6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:10:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-cb708d55-b5d4-4fe1-a1f7-b58f8a5bcdd6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:10:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-cb708d55-b5d4-4fe1-a1f7-b58f8a5bcdd6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:10:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-cb708d55-b5d4-4fe1-a1f7-b58f8a5bcdd6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:10:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-cb708d55-b5d4-4fe1-a1f7-b58f8a5bcdd6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:10:08 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-cb708d55-b5d4-4fe1-a1f7-b58f8a5bcdd6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] HTTP exception thrown: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. Apr 17 11:10:08 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-cb708d55-b5d4-4fe1-a1f7-b58f8a5bcdd6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Request method failure captured: Apr 17 11:10:08 user devstack@n-api.service[72743]: request: DELETE /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 HTTP/1.1 Apr 17 11:10:08 user devstack@n-api.service[72743]: Accept: application/json Apr 17 11:10:08 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 11:10:08 user devstack@n-api.service[72743]: Connection: close Apr 17 11:10:08 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 11:10:08 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 11:10:08 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 11:10:08 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 11:10:08 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 11:10:08 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSNDDukOA8EPGS_JB9BsvtkI9C7IEIOZRqMnIfWkrLT4xoIZaX0pcEoI0m7n5QDjj9YhnvQl9_4zK2ppURuFVv3B8rHwHUMgGTge6_4n3i8OhDt-XaWKbcEY3OMG0sXTCZ5H1g2CzMX9wwItjKWNb07Gf-LHL2aAzmNlLTXBm-ti6e8 Apr 17 11:10:08 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 11:10:08 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 11:10:08 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 11:10:08 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 11:10:08 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 11:10:08 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 11:10:08 user devstack@n-api.service[72743]: X-Project-Id: cc1b39ff9581474b87c58164e5cafa00 Apr 17 11:10:08 user devstack@n-api.service[72743]: X-Project-Name: tempest-ServerActionsTestJSON-2107442540 Apr 17 11:10:08 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 11:10:08 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 11:10:08 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc1b39ff9581474b87c58164e5cafa00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc1b39ff9581474b87c58164e5cafa00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cc1b39ff9581474b87c58164e5cafa00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:10:08 user devstack@n-api.service[72743]: X-Tenant: tempest-ServerActionsTestJSON-2107442540 Apr 17 11:10:08 user devstack@n-api.service[72743]: X-Tenant-Id: cc1b39ff9581474b87c58164e5cafa00 Apr 17 11:10:08 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-ServerActionsTestJSON-2107442540 Apr 17 11:10:08 user devstack@n-api.service[72743]: X-User: tempest-ServerActionsTestJSON-2107442540-project-member Apr 17 11:10:08 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 11:10:08 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 11:10:08 user devstack@n-api.service[72743]: X-User-Id: a7e218d771db49e88d13d3b088f3d88a Apr 17 11:10:08 user devstack@n-api.service[72743]: X-User-Name: tempest-ServerActionsTestJSON-2107442540-project-member Apr 17 11:10:08 user devstack@n-api.service[72743]: method: > Apr 17 11:10:08 user devstack@n-api.service[72743]: exception: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. Apr 17 11:10:08 user devstack@n-api.service[72743]: action_args: {'id': '2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38'} Apr 17 11:10:08 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. Apr 17 11:10:08 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:10:08 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-cb708d55-b5d4-4fe1-a1f7-b58f8a5bcdd6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Returning 404 to user: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:10:08 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-cb708d55-b5d4-4fe1-a1f7-b58f8a5bcdd6 tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 404 len: 111 microversion: 2.1 time: 0.036828 Apr 17 11:10:08 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 347/1033] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 11:10:08 2023] DELETE /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 11:10:08 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:10:08 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:10:08 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-1110785b-cf4f-4aac-ae57-ff6f9f5099ce tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:10:08 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-1110785b-cf4f-4aac-ae57-ff6f9f5099ce tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] [instance: 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:10:08 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1110785b-cf4f-4aac-ae57-ff6f9f5099ce tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:10:08 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1110785b-cf4f-4aac-ae57-ff6f9f5099ce tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:10:08 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1110785b-cf4f-4aac-ae57-ff6f9f5099ce tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:10:08 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1110785b-cf4f-4aac-ae57-ff6f9f5099ce tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:10:08 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1110785b-cf4f-4aac-ae57-ff6f9f5099ce tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:10:08 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1110785b-cf4f-4aac-ae57-ff6f9f5099ce tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:10:08 user devstack@n-api.service[72744]: INFO nova.api.openstack.wsgi [None req-1110785b-cf4f-4aac-ae57-ff6f9f5099ce tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] HTTP exception thrown: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. Apr 17 11:10:08 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-1110785b-cf4f-4aac-ae57-ff6f9f5099ce tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Request method failure captured: Apr 17 11:10:08 user devstack@n-api.service[72744]: request: GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 HTTP/1.1 Apr 17 11:10:08 user devstack@n-api.service[72744]: Accept: application/json Apr 17 11:10:08 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 11:10:08 user devstack@n-api.service[72744]: Connection: close Apr 17 11:10:08 user devstack@n-api.service[72744]: Content-Length: 0 Apr 17 11:10:08 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 11:10:08 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 11:10:08 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 11:10:08 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 11:10:08 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSNDDukOA8EPGS_JB9BsvtkI9C7IEIOZRqMnIfWkrLT4xoIZaX0pcEoI0m7n5QDjj9YhnvQl9_4zK2ppURuFVv3B8rHwHUMgGTge6_4n3i8OhDt-XaWKbcEY3OMG0sXTCZ5H1g2CzMX9wwItjKWNb07Gf-LHL2aAzmNlLTXBm-ti6e8 Apr 17 11:10:08 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 11:10:08 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 11:10:08 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 11:10:08 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 11:10:08 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 11:10:08 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 11:10:08 user devstack@n-api.service[72744]: X-Project-Id: cc1b39ff9581474b87c58164e5cafa00 Apr 17 11:10:08 user devstack@n-api.service[72744]: X-Project-Name: tempest-ServerActionsTestJSON-2107442540 Apr 17 11:10:08 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 11:10:08 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 11:10:08 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc1b39ff9581474b87c58164e5cafa00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc1b39ff9581474b87c58164e5cafa00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cc1b39ff9581474b87c58164e5cafa00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:10:08 user devstack@n-api.service[72744]: X-Tenant: tempest-ServerActionsTestJSON-2107442540 Apr 17 11:10:08 user devstack@n-api.service[72744]: X-Tenant-Id: cc1b39ff9581474b87c58164e5cafa00 Apr 17 11:10:08 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-ServerActionsTestJSON-2107442540 Apr 17 11:10:08 user devstack@n-api.service[72744]: X-User: tempest-ServerActionsTestJSON-2107442540-project-member Apr 17 11:10:08 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 11:10:08 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 11:10:08 user devstack@n-api.service[72744]: X-User-Id: a7e218d771db49e88d13d3b088f3d88a Apr 17 11:10:08 user devstack@n-api.service[72744]: X-User-Name: tempest-ServerActionsTestJSON-2107442540-project-member Apr 17 11:10:08 user devstack@n-api.service[72744]: method: > Apr 17 11:10:08 user devstack@n-api.service[72744]: exception: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. Apr 17 11:10:08 user devstack@n-api.service[72744]: action_args: {'id': '2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38'} Apr 17 11:10:08 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. Apr 17 11:10:08 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:10:08 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-1110785b-cf4f-4aac-ae57-ff6f9f5099ce tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Returning 404 to user: Instance 2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 could not be found. {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:10:08 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-1110785b-cf4f-4aac-ae57-ff6f9f5099ce tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38" status: 404 len: 111 microversion: 2.1 time: 0.068714 Apr 17 11:10:08 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 334/1034] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:10:08 2023] GET /compute/v2.1/servers/2dba2da1-5cae-4b9a-8a0e-ec7bff8a1d38 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 11:10:08 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-e1908ac1-b371-42fe-8f68-401d0db81e1a tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] Calling method '.version_select at 0x7fc55a9ce7a0>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:10:08 user devstack@n-api.service[72745]: INFO oslo.messaging._drivers.impl_rabbit [-] [a6512bb3-50d1-485e-9503-ae2677ff2705] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 43422. Apr 17 11:10:08 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-e1908ac1-b371-42fe-8f68-401d0db81e1a tempest-ServerActionsTestJSON-2107442540 tempest-ServerActionsTestJSON-2107442540-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-681910651" status: 202 len: 0 microversion: 2.1 time: 0.026576 Apr 17 11:10:08 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 354/1035] 10.0.0.210 () {62 vars in 1295 bytes} [Mon Apr 17 11:10:08 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-681910651 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 11:10:14 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-5ae1fc34-882c-4e5d-a752-b0dab30a1248 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:10:14 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-5ae1fc34-882c-4e5d-a752-b0dab30a1248 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:10:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5ae1fc34-882c-4e5d-a752-b0dab30a1248 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:10:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5ae1fc34-882c-4e5d-a752-b0dab30a1248 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:10:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5ae1fc34-882c-4e5d-a752-b0dab30a1248 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:10:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5ae1fc34-882c-4e5d-a752-b0dab30a1248 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:10:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5ae1fc34-882c-4e5d-a752-b0dab30a1248 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:10:14 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5ae1fc34-882c-4e5d-a752-b0dab30a1248 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:10:14 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-5ae1fc34-882c-4e5d-a752-b0dab30a1248 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.284086 Apr 17 11:10:14 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 348/1036] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 17 11:10:14 2023] GET /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/os-interface => generated 282 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:10:16 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-b0148a01-5de9-44b3-970f-c2e9605870b6 req-b740e485-3fa5-465a-91d2-8e82b581a3f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6", "tag": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:10:16 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-b0148a01-5de9-44b3-970f-c2e9605870b6 req-b740e485-3fa5-465a-91d2-8e82b581a3f8 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:10:16 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-b0148a01-5de9-44b3-970f-c2e9605870b6 req-b740e485-3fa5-465a-91d2-8e82b581a3f8 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:10:16 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-b0148a01-5de9-44b3-970f-c2e9605870b6 req-b740e485-3fa5-465a-91d2-8e82b581a3f8 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:10:16 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-b0148a01-5de9-44b3-970f-c2e9605870b6 req-b740e485-3fa5-465a-91d2-8e82b581a3f8 service nova] Creating event network-changed:bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 on user Apr 17 11:10:16 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-b0148a01-5de9-44b3-970f-c2e9605870b6 req-b740e485-3fa5-465a-91d2-8e82b581a3f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033357 Apr 17 11:10:16 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 335/1037] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:10:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:10:16 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:10:16 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:10:16 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:10:16 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:10:16 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:10:16 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:10:16 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:10:16 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:10:16 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:10:16 user devstack@n-api.service[72745]: DEBUG nova.objects.instance [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lazy-loading 'services' on Instance uuid d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 {{(pid=72745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 11:10:16 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-e0089972-e0f1-4c5b-8e53-1d097d85ce04 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/os-volume_attachments/9884dc01-fc15-48b8-935e-eef5420d68b1" status: 202 len: 0 microversion: 2.1 time: 0.196814 Apr 17 11:10:16 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 355/1038] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Apr 17 11:10:16 2023] DELETE /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/os-volume_attachments/9884dc01-fc15-48b8-935e-eef5420d68b1 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 11:10:16 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-5bf6bcdb-3189-44a3-9f45-b41871c6181b tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:10:16 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-5bf6bcdb-3189-44a3-9f45-b41871c6181b tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:10:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5bf6bcdb-3189-44a3-9f45-b41871c6181b tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:10:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5bf6bcdb-3189-44a3-9f45-b41871c6181b tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:10:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5bf6bcdb-3189-44a3-9f45-b41871c6181b tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:10:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5bf6bcdb-3189-44a3-9f45-b41871c6181b tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:10:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5bf6bcdb-3189-44a3-9f45-b41871c6181b tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:10:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-5bf6bcdb-3189-44a3-9f45-b41871c6181b tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:10:16 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-5bf6bcdb-3189-44a3-9f45-b41871c6181b tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041962 Apr 17 11:10:16 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 349/1039] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 11:10:16 2023] GET /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:10:18 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-33b5d40d-6757-46bd-b298-c170103fdba8 req-056f00ce-f993-4b6c-afc6-e0b6749e45e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6", "tag": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:10:18 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-33b5d40d-6757-46bd-b298-c170103fdba8 req-056f00ce-f993-4b6c-afc6-e0b6749e45e5 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:10:18 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-33b5d40d-6757-46bd-b298-c170103fdba8 req-056f00ce-f993-4b6c-afc6-e0b6749e45e5 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:10:18 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-33b5d40d-6757-46bd-b298-c170103fdba8 req-056f00ce-f993-4b6c-afc6-e0b6749e45e5 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:10:18 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-33b5d40d-6757-46bd-b298-c170103fdba8 req-056f00ce-f993-4b6c-afc6-e0b6749e45e5 service nova] Creating event network-changed:bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 on user Apr 17 11:10:18 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-33b5d40d-6757-46bd-b298-c170103fdba8 req-056f00ce-f993-4b6c-afc6-e0b6749e45e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029861 Apr 17 11:10:18 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 336/1040] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:10:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:10:22 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-13b9f086-a6bd-467a-be3a-b03ce31cc7b0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Action: 'create', calling method: .version_select at 0x7fc55a9cf9a0>, body: {"keypair": {"name": "tempest-keypair-1469598392", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ04c7v86JHMXBmJMTmyNeA0qqN/cuBpmzV6m2UWiAkn3llbc6tHPrkAHzr1XTDzkYeypgUcGkGVFUIPNX7q3NKjpvG9aPeS89G8eGq6TwkmjxrkSFdaRb8QjNiIPT6IDg=="}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:10:22 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-13b9f086-a6bd-467a-be3a-b03ce31cc7b0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Getting quotas for project 64eccc3b86914e4ab735b79c4b53a142. Resources: {'key_pairs'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 11:10:22 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-13b9f086-a6bd-467a-be3a-b03ce31cc7b0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Getting quotas for user 8fc272a75798487d84beedfa65775423 and project 64eccc3b86914e4ab735b79c4b53a142. Resources: {'key_pairs'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 11:10:22 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-13b9f086-a6bd-467a-be3a-b03ce31cc7b0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.118826 Apr 17 11:10:22 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 356/1041] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 11:10:21 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:10:23 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1924403157", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce"}], "security_groups": [{"name": "tempest-securitygroup--1317509971"}], "key_name": "tempest-keypair-1469598392", "user_data": "}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:10:23 user devstack@n-api.service[72743]: DEBUG nova.network.neutron [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] validate_networks() for [('7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce', None, None, None, None, None)] {{(pid=72743) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 11:10:24 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Flavor limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 11:10:24 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Image limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 11:10:24 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Flavor pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 11:10:24 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Image pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 11:10:24 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 11:10:24 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:10:24 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:10:24 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:10:24 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:10:24 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:10:24 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:10:24 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Getting quotas for project 64eccc3b86914e4ab735b79c4b53a142. Resources: {'cores', 'instances', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 11:10:24 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Getting quotas for user 8fc272a75798487d84beedfa65775423 and project 64eccc3b86914e4ab735b79c4b53a142. Resources: {'cores', 'instances', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 11:10:24 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Going to run 1 instances... {{(pid=72743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 11:10:24 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 11:10:24 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-3e568cfc-c4f9-44b1-a7b6-cb310f794cd8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.625617 Apr 17 11:10:24 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 350/1042] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 11:10:23 2023] POST /compute/v2.1/servers => generated 400 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 11:10:24 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-c26e0c9b-cc44-4bed-94b7-d9195e5cc0db tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:10:24 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-c26e0c9b-cc44-4bed-94b7-d9195e5cc0db tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:10:24 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-c26e0c9b-cc44-4bed-94b7-d9195e5cc0db tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc272a75798487d84beedfa65775423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eccc3b86914e4ab735b79c4b53a142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:10:24 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-c26e0c9b-cc44-4bed-94b7-d9195e5cc0db tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061" status: 200 len: 1236 microversion: 2.1 time: 0.066975 Apr 17 11:10:24 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 337/1043] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:10:24 2023] GET /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061 => generated 1236 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:10:26 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:10:26 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-2800c41c-cc52-4d46-9bf8-6b50b79bd2fb req-e0a4dafc-d45c-47bd-8327-d35d208b58b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "027f1645-6991-4726-b1f4-2728db710061", "tag": "8c280312-1554-4ee3-aadd-aa4929fecbda"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:10:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-2800c41c-cc52-4d46-9bf8-6b50b79bd2fb req-e0a4dafc-d45c-47bd-8327-d35d208b58b5 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:10:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-2800c41c-cc52-4d46-9bf8-6b50b79bd2fb req-e0a4dafc-d45c-47bd-8327-d35d208b58b5 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:10:26 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-2800c41c-cc52-4d46-9bf8-6b50b79bd2fb req-e0a4dafc-d45c-47bd-8327-d35d208b58b5 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:10:26 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-2800c41c-cc52-4d46-9bf8-6b50b79bd2fb req-e0a4dafc-d45c-47bd-8327-d35d208b58b5 service nova] Creating event network-changed:8c280312-1554-4ee3-aadd-aa4929fecbda for instance 027f1645-6991-4726-b1f4-2728db710061 on user Apr 17 11:10:26 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-2800c41c-cc52-4d46-9bf8-6b50b79bd2fb req-e0a4dafc-d45c-47bd-8327-d35d208b58b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056291 Apr 17 11:10:26 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 357/1044] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:10:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:10:28 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-3d00c30e-b306-4245-8630-405865a9bef0 req-599ec2e3-4acf-4a22-9479-095ab8e8a1fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "027f1645-6991-4726-b1f4-2728db710061", "name": "network-vif-plugged", "status": "completed", "tag": "8c280312-1554-4ee3-aadd-aa4929fecbda"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:10:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-3d00c30e-b306-4245-8630-405865a9bef0 req-599ec2e3-4acf-4a22-9479-095ab8e8a1fe service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:10:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-3d00c30e-b306-4245-8630-405865a9bef0 req-599ec2e3-4acf-4a22-9479-095ab8e8a1fe service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:10:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-3d00c30e-b306-4245-8630-405865a9bef0 req-599ec2e3-4acf-4a22-9479-095ab8e8a1fe service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:10:28 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-3d00c30e-b306-4245-8630-405865a9bef0 req-599ec2e3-4acf-4a22-9479-095ab8e8a1fe service nova] Creating event network-vif-plugged:8c280312-1554-4ee3-aadd-aa4929fecbda for instance 027f1645-6991-4726-b1f4-2728db710061 on user Apr 17 11:10:28 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-3d00c30e-b306-4245-8630-405865a9bef0 req-599ec2e3-4acf-4a22-9479-095ab8e8a1fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034089 Apr 17 11:10:28 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 351/1045] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:10:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 11:10:30 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-68a2cacf-638b-4e8c-be20-f4ae4e750fbe req-4dbc529b-8b70-4f5d-9772-fc2e1f8a9a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "027f1645-6991-4726-b1f4-2728db710061", "name": "network-vif-plugged", "status": "completed", "tag": "8c280312-1554-4ee3-aadd-aa4929fecbda"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:10:30 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:10:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-68a2cacf-638b-4e8c-be20-f4ae4e750fbe req-4dbc529b-8b70-4f5d-9772-fc2e1f8a9a8d service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:10:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-68a2cacf-638b-4e8c-be20-f4ae4e750fbe req-4dbc529b-8b70-4f5d-9772-fc2e1f8a9a8d service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:10:30 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-68a2cacf-638b-4e8c-be20-f4ae4e750fbe req-4dbc529b-8b70-4f5d-9772-fc2e1f8a9a8d service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:10:30 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-68a2cacf-638b-4e8c-be20-f4ae4e750fbe req-4dbc529b-8b70-4f5d-9772-fc2e1f8a9a8d service nova] Creating event network-vif-plugged:8c280312-1554-4ee3-aadd-aa4929fecbda for instance 027f1645-6991-4726-b1f4-2728db710061 on user Apr 17 11:10:30 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-68a2cacf-638b-4e8c-be20-f4ae4e750fbe req-4dbc529b-8b70-4f5d-9772-fc2e1f8a9a8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031507 Apr 17 11:10:30 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 338/1046] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:10:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:11:06 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=4 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:11:06 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:11:06 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:11:06 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-9fec8d5a-492f-4442-9730-53cc00930c10 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:11:06 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-9fec8d5a-492f-4442-9730-53cc00930c10 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:11:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9fec8d5a-492f-4442-9730-53cc00930c10 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:11:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9fec8d5a-492f-4442-9730-53cc00930c10 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:11:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9fec8d5a-492f-4442-9730-53cc00930c10 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:11:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9fec8d5a-492f-4442-9730-53cc00930c10 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:11:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9fec8d5a-492f-4442-9730-53cc00930c10 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:11:06 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9fec8d5a-492f-4442-9730-53cc00930c10 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:11:06 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-9fec8d5a-492f-4442-9730-53cc00930c10 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091425 Apr 17 11:11:06 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 358/1047] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 11:11:06 2023] GET /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 17 11:11:06 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:11:06 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:11:06 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:11:06 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=16 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:11:06 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:11:06 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:11:06 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:11:06 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:11:06 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:11:06 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:11:06 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:11:06 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:11:06 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Going to try to terminate instance {{(pid=72743) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 11:11:06 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-fc6849d4-91ee-49b8-847a-5e27508c15c3 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" status: 204 len: 0 microversion: 2.1 time: 0.120309 Apr 17 11:11:06 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 352/1048] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 11:11:06 2023] DELETE /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 11:11:06 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:11:06 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=12 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:11:06 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:11:06 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-d1b4a461-13f0-45b9-a263-a856e4ad6b6a tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:11:06 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-d1b4a461-13f0-45b9-a263-a856e4ad6b6a tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:11:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d1b4a461-13f0-45b9-a263-a856e4ad6b6a tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:11:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d1b4a461-13f0-45b9-a263-a856e4ad6b6a tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:11:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d1b4a461-13f0-45b9-a263-a856e4ad6b6a tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:11:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d1b4a461-13f0-45b9-a263-a856e4ad6b6a tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:11:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d1b4a461-13f0-45b9-a263-a856e4ad6b6a tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:11:07 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d1b4a461-13f0-45b9-a263-a856e4ad6b6a tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:11:07 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-d984b593-3715-4977-83cd-bc85aa8fa096 req-e2f75911-28a3-415a-9aaf-9de0069b2783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6", "name": "network-vif-unplugged", "status": "completed", "tag": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:11:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-d984b593-3715-4977-83cd-bc85aa8fa096 req-e2f75911-28a3-415a-9aaf-9de0069b2783 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:11:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-d984b593-3715-4977-83cd-bc85aa8fa096 req-e2f75911-28a3-415a-9aaf-9de0069b2783 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:11:07 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-d984b593-3715-4977-83cd-bc85aa8fa096 req-e2f75911-28a3-415a-9aaf-9de0069b2783 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:11:07 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-d984b593-3715-4977-83cd-bc85aa8fa096 req-e2f75911-28a3-415a-9aaf-9de0069b2783 service nova] Creating event network-vif-unplugged:bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 on user Apr 17 11:11:07 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-d984b593-3715-4977-83cd-bc85aa8fa096 req-e2f75911-28a3-415a-9aaf-9de0069b2783 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036291 Apr 17 11:11:07 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 359/1049] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:11:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:11:07 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-d1b4a461-13f0-45b9-a263-a856e4ad6b6a tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c15ce534a649ae8a971b33221e2500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747b7d3c6844772b0e6eed5299053ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:11:07 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-d1b4a461-13f0-45b9-a263-a856e4ad6b6a tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" status: 200 len: 1677 microversion: 2.1 time: 0.308150 Apr 17 11:11:07 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 339/1050] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:11:06 2023] GET /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 => generated 1677 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:11:08 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-d35832bf-e4a4-47ec-b99b-6961b50d784f req-8d8832f8-7484-4a7f-9de4-3546a9a8b280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6", "name": "network-vif-deleted", "tag": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:11:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-d35832bf-e4a4-47ec-b99b-6961b50d784f req-8d8832f8-7484-4a7f-9de4-3546a9a8b280 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:11:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-d35832bf-e4a4-47ec-b99b-6961b50d784f req-8d8832f8-7484-4a7f-9de4-3546a9a8b280 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:11:08 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-d35832bf-e4a4-47ec-b99b-6961b50d784f req-8d8832f8-7484-4a7f-9de4-3546a9a8b280 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:11:08 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-d35832bf-e4a4-47ec-b99b-6961b50d784f req-8d8832f8-7484-4a7f-9de4-3546a9a8b280 service nova] Creating event network-vif-deleted:bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 on user Apr 17 11:11:08 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-d35832bf-e4a4-47ec-b99b-6961b50d784f req-8d8832f8-7484-4a7f-9de4-3546a9a8b280 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036853 Apr 17 11:11:08 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 353/1051] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:11:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:11:09 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-76dfd7ff-bca1-4c13-9130-405baa9b40cb req-6da4f9a5-f752-4d03-b175-8ed7265cfd44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3ee5567-1a2d-4db4-8519-ba4308d8d3b6", "name": "network-vif-plugged", "status": "completed", "tag": "bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:11:09 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-76dfd7ff-bca1-4c13-9130-405baa9b40cb req-6da4f9a5-f752-4d03-b175-8ed7265cfd44 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:11:09 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-76dfd7ff-bca1-4c13-9130-405baa9b40cb req-6da4f9a5-f752-4d03-b175-8ed7265cfd44 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:11:09 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-76dfd7ff-bca1-4c13-9130-405baa9b40cb req-6da4f9a5-f752-4d03-b175-8ed7265cfd44 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:11:09 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-76dfd7ff-bca1-4c13-9130-405baa9b40cb req-6da4f9a5-f752-4d03-b175-8ed7265cfd44 service nova] Creating event network-vif-plugged:bb97f09f-c73c-4e73-9dd6-8e9ea09a2fc4 for instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 on user Apr 17 11:11:09 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-76dfd7ff-bca1-4c13-9130-405baa9b40cb req-6da4f9a5-f752-4d03-b175-8ed7265cfd44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030105 Apr 17 11:11:09 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 360/1052] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:11:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:11:14 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-89db5dc4-d436-49dc-b951-34312eacb7d4 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:11:14 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-89db5dc4-d436-49dc-b951-34312eacb7d4 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:11:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-89db5dc4-d436-49dc-b951-34312eacb7d4 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:11:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-89db5dc4-d436-49dc-b951-34312eacb7d4 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:11:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-89db5dc4-d436-49dc-b951-34312eacb7d4 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:11:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-89db5dc4-d436-49dc-b951-34312eacb7d4 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:11:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-89db5dc4-d436-49dc-b951-34312eacb7d4 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:11:14 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-89db5dc4-d436-49dc-b951-34312eacb7d4 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:11:14 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-89db5dc4-d436-49dc-b951-34312eacb7d4 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc272a75798487d84beedfa65775423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eccc3b86914e4ab735b79c4b53a142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:11:14 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-89db5dc4-d436-49dc-b951-34312eacb7d4 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061" status: 200 len: 1545 microversion: 2.1 time: 0.210586 Apr 17 11:11:14 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 340/1053] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:11:14 2023] GET /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061 => generated 1545 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:11:57 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:11:57 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:11:57 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-d9e6bbf0-7295-4e1b-b09b-481b97612ed4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:11:57 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-d9e6bbf0-7295-4e1b-b09b-481b97612ed4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: d3ee5567-1a2d-4db4-8519-ba4308d8d3b6] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:11:57 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d9e6bbf0-7295-4e1b-b09b-481b97612ed4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:11:57 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d9e6bbf0-7295-4e1b-b09b-481b97612ed4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:11:57 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d9e6bbf0-7295-4e1b-b09b-481b97612ed4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:11:57 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d9e6bbf0-7295-4e1b-b09b-481b97612ed4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:11:57 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d9e6bbf0-7295-4e1b-b09b-481b97612ed4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:11:57 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-d9e6bbf0-7295-4e1b-b09b-481b97612ed4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:11:57 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-d9e6bbf0-7295-4e1b-b09b-481b97612ed4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] HTTP exception thrown: Instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 could not be found. Apr 17 11:11:57 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-d9e6bbf0-7295-4e1b-b09b-481b97612ed4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Request method failure captured: Apr 17 11:11:57 user devstack@n-api.service[72743]: request: GET /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 HTTP/1.1 Apr 17 11:11:57 user devstack@n-api.service[72743]: Accept: application/json Apr 17 11:11:57 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 11:11:57 user devstack@n-api.service[72743]: Connection: close Apr 17 11:11:57 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 11:11:57 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 11:11:57 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 11:11:57 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 11:11:57 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 11:11:57 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSW-MrZeODEec0-GgKUVgcRRo9sR4IeW6R89M43QejliWYRYWbCdjzy6wRMS_cGtnxUrDzja9_DSrU_6Fw-WleIpEonGoJmFRMs8ds6cyemfdZByXsb2oi00E8GmlY0wlg6_XxhRgCWsYq5BBZzlT8hJjqZ7UMV7PuzjMaKmHClTbJ4 Apr 17 11:11:57 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 11:11:57 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 11:11:57 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 11:11:57 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 11:11:57 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 11:11:57 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 11:11:57 user devstack@n-api.service[72743]: X-Project-Id: 3747b7d3c6844772b0e6eed5299053ba Apr 17 11:11:57 user devstack@n-api.service[72743]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1988041396 Apr 17 11:11:57 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 11:11:57 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 11:11:57 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3747b7d3c6844772b0e6eed5299053ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3747b7d3c6844772b0e6eed5299053ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3747b7d3c6844772b0e6eed5299053ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:11:57 user devstack@n-api.service[72743]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1988041396 Apr 17 11:11:57 user devstack@n-api.service[72743]: X-Tenant-Id: 3747b7d3c6844772b0e6eed5299053ba Apr 17 11:11:57 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1988041396 Apr 17 11:11:57 user devstack@n-api.service[72743]: X-User: tempest-ServerRescueNegativeTestJSON-1988041396-project-member Apr 17 11:11:57 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 11:11:57 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 11:11:57 user devstack@n-api.service[72743]: X-User-Id: 30c15ce534a649ae8a971b33221e2500 Apr 17 11:11:57 user devstack@n-api.service[72743]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1988041396-project-member Apr 17 11:11:57 user devstack@n-api.service[72743]: method: > Apr 17 11:11:57 user devstack@n-api.service[72743]: exception: Instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 could not be found. Apr 17 11:11:57 user devstack@n-api.service[72743]: action_args: {'id': 'd3ee5567-1a2d-4db4-8519-ba4308d8d3b6'} Apr 17 11:11:57 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 could not be found. Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 could not be found. Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 could not be found. Apr 17 11:11:57 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:11:57 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-d9e6bbf0-7295-4e1b-b09b-481b97612ed4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Returning 404 to user: Instance d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:11:57 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-d9e6bbf0-7295-4e1b-b09b-481b97612ed4 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6" status: 404 len: 111 microversion: 2.1 time: 0.039575 Apr 17 11:11:57 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 354/1054] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:11:57 2023] GET /compute/v2.1/servers/d3ee5567-1a2d-4db4-8519-ba4308d8d3b6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 11:11:57 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:11:57 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=10 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:11:57 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-cf4af5cd-b581-490a-85f4-e91b6e74c34c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '.version_select at 0x7fc55a7b64d0>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:11:57 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-cf4af5cd-b581-490a-85f4-e91b6e74c34c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1731392485" status: 202 len: 0 microversion: 2.1 time: 0.038240 Apr 17 11:11:57 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 361/1055] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Apr 17 11:11:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1731392485 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 11:12:04 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:12:04 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:12:04 user devstack@n-api.service[72744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 17 11:12:04 user devstack@n-api.service[72744]: Mon Apr 17 11:12:04 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/385a180f-e722-4826-a6e0-47608461e66e (ip 10.0.0.210) !!! Apr 17 11:12:04 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=4 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:12:04 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=12 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:12:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:04 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:04 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Going to try to terminate instance {{(pid=72744) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 11:12:04 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-265c41ee-f5ce-4e2d-90a0-8bf0d1296005 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/385a180f-e722-4826-a6e0-47608461e66e" status: 204 len: 0 microversion: 2.1 time: 0.137712 Apr 17 11:12:04 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 341/1056] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 11:12:04 2023] DELETE /compute/v2.1/servers/385a180f-e722-4826-a6e0-47608461e66e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 11:12:04 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-ffbbffe5-cbd9-4495-80de-9d46472c190c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:12:04 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-ffbbffe5-cbd9-4495-80de-9d46472c190c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:12:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ffbbffe5-cbd9-4495-80de-9d46472c190c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ffbbffe5-cbd9-4495-80de-9d46472c190c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ffbbffe5-cbd9-4495-80de-9d46472c190c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ffbbffe5-cbd9-4495-80de-9d46472c190c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ffbbffe5-cbd9-4495-80de-9d46472c190c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-ffbbffe5-cbd9-4495-80de-9d46472c190c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:05 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-ea7080a1-e6e9-4737-839f-a7820deda2ce req-022a3b7e-4e34-45bd-a161-4e571bbd4aaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "385a180f-e722-4826-a6e0-47608461e66e", "name": "network-vif-unplugged", "status": "completed", "tag": "8fca060e-eb45-4132-9515-99574c15e1a0"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:12:05 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-ffbbffe5-cbd9-4495-80de-9d46472c190c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c15ce534a649ae8a971b33221e2500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747b7d3c6844772b0e6eed5299053ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:12:05 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-ea7080a1-e6e9-4737-839f-a7820deda2ce req-022a3b7e-4e34-45bd-a161-4e571bbd4aaa service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:05 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-ea7080a1-e6e9-4737-839f-a7820deda2ce req-022a3b7e-4e34-45bd-a161-4e571bbd4aaa service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:05 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-ffbbffe5-cbd9-4495-80de-9d46472c190c tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/385a180f-e722-4826-a6e0-47608461e66e" status: 200 len: 1494 microversion: 2.1 time: 0.285056 Apr 17 11:12:05 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-ea7080a1-e6e9-4737-839f-a7820deda2ce req-022a3b7e-4e34-45bd-a161-4e571bbd4aaa service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:05 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 355/1057] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:12:04 2023] GET /compute/v2.1/servers/385a180f-e722-4826-a6e0-47608461e66e => generated 1494 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:12:05 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-ea7080a1-e6e9-4737-839f-a7820deda2ce req-022a3b7e-4e34-45bd-a161-4e571bbd4aaa service nova] Creating event network-vif-unplugged:8fca060e-eb45-4132-9515-99574c15e1a0 for instance 385a180f-e722-4826-a6e0-47608461e66e on user Apr 17 11:12:05 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-ea7080a1-e6e9-4737-839f-a7820deda2ce req-022a3b7e-4e34-45bd-a161-4e571bbd4aaa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040146 Apr 17 11:12:05 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 362/1058] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:12:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:12:05 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-0bc9972b-28f5-4035-bcaa-45547afb2e2c req-20b5f50f-103d-4389-b172-400292fe319e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "385a180f-e722-4826-a6e0-47608461e66e", "name": "network-vif-deleted", "tag": "8fca060e-eb45-4132-9515-99574c15e1a0"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:12:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-0bc9972b-28f5-4035-bcaa-45547afb2e2c req-20b5f50f-103d-4389-b172-400292fe319e service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-0bc9972b-28f5-4035-bcaa-45547afb2e2c req-20b5f50f-103d-4389-b172-400292fe319e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:05 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-0bc9972b-28f5-4035-bcaa-45547afb2e2c req-20b5f50f-103d-4389-b172-400292fe319e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:05 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-0bc9972b-28f5-4035-bcaa-45547afb2e2c req-20b5f50f-103d-4389-b172-400292fe319e service nova] Creating event network-vif-deleted:8fca060e-eb45-4132-9515-99574c15e1a0 for instance 385a180f-e722-4826-a6e0-47608461e66e on user Apr 17 11:12:05 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-0bc9972b-28f5-4035-bcaa-45547afb2e2c req-20b5f50f-103d-4389-b172-400292fe319e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030989 Apr 17 11:12:05 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 342/1059] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:12:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:12:07 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-d7a5e217-432c-43c1-ac7a-00e85a1e8c57 req-0580e35b-fda1-417f-a989-8b519bef8206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "385a180f-e722-4826-a6e0-47608461e66e", "name": "network-vif-plugged", "status": "completed", "tag": "8fca060e-eb45-4132-9515-99574c15e1a0"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:12:07 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-d7a5e217-432c-43c1-ac7a-00e85a1e8c57 req-0580e35b-fda1-417f-a989-8b519bef8206 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:07 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-d7a5e217-432c-43c1-ac7a-00e85a1e8c57 req-0580e35b-fda1-417f-a989-8b519bef8206 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:07 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-d7a5e217-432c-43c1-ac7a-00e85a1e8c57 req-0580e35b-fda1-417f-a989-8b519bef8206 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:07 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-d7a5e217-432c-43c1-ac7a-00e85a1e8c57 req-0580e35b-fda1-417f-a989-8b519bef8206 service nova] Creating event network-vif-plugged:8fca060e-eb45-4132-9515-99574c15e1a0 for instance 385a180f-e722-4826-a6e0-47608461e66e on user Apr 17 11:12:07 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-d7a5e217-432c-43c1-ac7a-00e85a1e8c57 req-0580e35b-fda1-417f-a989-8b519bef8206 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115130 Apr 17 11:12:07 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 356/1060] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:12:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:12:14 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-c6be8556-111a-4dbe-b342-48d98c2002ea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:12:14 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-c6be8556-111a-4dbe-b342-48d98c2002ea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:12:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c6be8556-111a-4dbe-b342-48d98c2002ea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c6be8556-111a-4dbe-b342-48d98c2002ea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c6be8556-111a-4dbe-b342-48d98c2002ea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c6be8556-111a-4dbe-b342-48d98c2002ea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c6be8556-111a-4dbe-b342-48d98c2002ea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c6be8556-111a-4dbe-b342-48d98c2002ea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:15 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-c6be8556-111a-4dbe-b342-48d98c2002ea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.229931 Apr 17 11:12:15 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 363/1061] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 17 11:12:14 2023] GET /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061/os-interface => generated 282 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:12:15 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-b654254d-4667-4f13-96ec-a932921ca265 req-6357ce6e-613d-4bbc-8c67-40df2d1e6ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "027f1645-6991-4726-b1f4-2728db710061", "tag": "8c280312-1554-4ee3-aadd-aa4929fecbda"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:12:15 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-b654254d-4667-4f13-96ec-a932921ca265 req-6357ce6e-613d-4bbc-8c67-40df2d1e6ba2 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:15 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-b654254d-4667-4f13-96ec-a932921ca265 req-6357ce6e-613d-4bbc-8c67-40df2d1e6ba2 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:15 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-b654254d-4667-4f13-96ec-a932921ca265 req-6357ce6e-613d-4bbc-8c67-40df2d1e6ba2 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:15 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-b654254d-4667-4f13-96ec-a932921ca265 req-6357ce6e-613d-4bbc-8c67-40df2d1e6ba2 service nova] Creating event network-changed:8c280312-1554-4ee3-aadd-aa4929fecbda for instance 027f1645-6991-4726-b1f4-2728db710061 on user Apr 17 11:12:15 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-b654254d-4667-4f13-96ec-a932921ca265 req-6357ce6e-613d-4bbc-8c67-40df2d1e6ba2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031640 Apr 17 11:12:15 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 343/1062] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:12:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:12:16 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-384971f5-1fff-4544-b1ff-7daa1d658fda tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:12:16 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-384971f5-1fff-4544-b1ff-7daa1d658fda tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:12:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-384971f5-1fff-4544-b1ff-7daa1d658fda tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-384971f5-1fff-4544-b1ff-7daa1d658fda tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-384971f5-1fff-4544-b1ff-7daa1d658fda tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-384971f5-1fff-4544-b1ff-7daa1d658fda tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-384971f5-1fff-4544-b1ff-7daa1d658fda tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-384971f5-1fff-4544-b1ff-7daa1d658fda tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:16 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-384971f5-1fff-4544-b1ff-7daa1d658fda tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061/ips" status: 200 len: 146 microversion: 2.1 time: 0.040041 Apr 17 11:12:16 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 357/1063] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 17 11:12:16 2023] GET /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:12:19 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3bcd996-c073-4475-8cd0-b64ef67190b5"}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:12:19 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:12:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:19 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:19 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-1b4b8a02-22fd-4854-bb09-f0eda2aa3f25 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "POST /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.347955 Apr 17 11:12:19 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 364/1064] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Apr 17 11:12:19 2023] POST /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:12:27 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:12:27 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:12:27 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-4c528be6-ad3c-4ea3-8f9e-9a19c019d7c3 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Action: 'create', calling method: .version_select at 0x7fc55aaa1cf0>, body: {"keypair": {"name": "tempest-keypair-1860561692", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7zxcsT2zwgrpSznzV5iu8363TIIRIzd2drQKgJ5YJXSwVES8tv4HR6SNG7+8lMNGBZruyNkTWf750NIkDBG6APskcc8pEaiiJQgfJsB7q2fZ/NHa1+AO+ecJosZrFlfg=="}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:12:27 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-4c528be6-ad3c-4ea3-8f9e-9a19c019d7c3 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Getting quotas for project 64eccc3b86914e4ab735b79c4b53a142. Resources: {'key_pairs'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 11:12:27 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-4c528be6-ad3c-4ea3-8f9e-9a19c019d7c3 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Getting quotas for user 8fc272a75798487d84beedfa65775423 and project 64eccc3b86914e4ab735b79c4b53a142. Resources: {'key_pairs'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 11:12:27 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-4c528be6-ad3c-4ea3-8f9e-9a19c019d7c3 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.061346 Apr 17 11:12:27 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 344/1065] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 11:12:27 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:12:28 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-817393154", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce"}], "security_groups": [{"name": "tempest-securitygroup--225000107"}], "key_name": "tempest-keypair-1860561692", "user_data": "}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:12:28 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=8 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:12:28 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=14 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:12:28 user devstack@n-api.service[72743]: DEBUG nova.network.neutron [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] validate_networks() for [('7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce', None, None, None, None, None)] {{(pid=72743) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 11:12:29 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Flavor limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 11:12:29 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Image limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 11:12:29 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Flavor pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 11:12:29 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Image pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 11:12:29 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 11:12:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:29 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:29 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Getting quotas for project 64eccc3b86914e4ab735b79c4b53a142. Resources: {'cores', 'instances', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 11:12:29 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Getting quotas for user 8fc272a75798487d84beedfa65775423 and project 64eccc3b86914e4ab735b79c4b53a142. Resources: {'cores', 'instances', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 11:12:29 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Going to run 1 instances... {{(pid=72743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 11:12:29 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 11:12:29 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-f3fdec78-23bf-4029-987f-356c71dbd14d tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.926156 Apr 17 11:12:29 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 358/1066] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 11:12:28 2023] POST /compute/v2.1/servers => generated 399 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 11:12:29 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-518ac6c9-631c-46eb-b0f8-8442acd2a965 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:12:29 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-518ac6c9-631c-46eb-b0f8-8442acd2a965 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:12:29 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:12:29 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:12:29 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-518ac6c9-631c-46eb-b0f8-8442acd2a965 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc272a75798487d84beedfa65775423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eccc3b86914e4ab735b79c4b53a142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:12:29 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-518ac6c9-631c-46eb-b0f8-8442acd2a965 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c9d8d80-93ff-41f3-85c3-b2175b4532a9" status: 200 len: 1235 microversion: 2.1 time: 0.093932 Apr 17 11:12:29 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 365/1067] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:12:29 2023] GET /compute/v2.1/servers/6c9d8d80-93ff-41f3-85c3-b2175b4532a9 => generated 1235 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:12:32 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-030b84f0-e15d-4f37-a511-ce7467f8460d req-528f1d18-7ebd-4d0e-9003-6734738d1228 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c9d8d80-93ff-41f3-85c3-b2175b4532a9", "tag": "13f9efc6-6c46-418e-90e7-675a328c3d97"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:12:32 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-030b84f0-e15d-4f37-a511-ce7467f8460d req-528f1d18-7ebd-4d0e-9003-6734738d1228 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:32 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-030b84f0-e15d-4f37-a511-ce7467f8460d req-528f1d18-7ebd-4d0e-9003-6734738d1228 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:32 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-030b84f0-e15d-4f37-a511-ce7467f8460d req-528f1d18-7ebd-4d0e-9003-6734738d1228 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:32 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-030b84f0-e15d-4f37-a511-ce7467f8460d req-528f1d18-7ebd-4d0e-9003-6734738d1228 service nova] Creating event network-changed:13f9efc6-6c46-418e-90e7-675a328c3d97 for instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 on user Apr 17 11:12:32 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-030b84f0-e15d-4f37-a511-ce7467f8460d req-528f1d18-7ebd-4d0e-9003-6734738d1228 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093576 Apr 17 11:12:32 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 345/1068] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:12:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:12:34 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-ba4438f9-f748-4876-b4d8-0e2aecef8fda req-8a6c61c8-a599-4188-bb43-5afa8ecbc486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c9d8d80-93ff-41f3-85c3-b2175b4532a9", "name": "network-vif-plugged", "status": "completed", "tag": "13f9efc6-6c46-418e-90e7-675a328c3d97"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:12:34 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-ba4438f9-f748-4876-b4d8-0e2aecef8fda req-8a6c61c8-a599-4188-bb43-5afa8ecbc486 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:34 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-ba4438f9-f748-4876-b4d8-0e2aecef8fda req-8a6c61c8-a599-4188-bb43-5afa8ecbc486 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:34 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-ba4438f9-f748-4876-b4d8-0e2aecef8fda req-8a6c61c8-a599-4188-bb43-5afa8ecbc486 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:34 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-ba4438f9-f748-4876-b4d8-0e2aecef8fda req-8a6c61c8-a599-4188-bb43-5afa8ecbc486 service nova] Creating event network-vif-plugged:13f9efc6-6c46-418e-90e7-675a328c3d97 for instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 on user Apr 17 11:12:34 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-ba4438f9-f748-4876-b4d8-0e2aecef8fda req-8a6c61c8-a599-4188-bb43-5afa8ecbc486 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028901 Apr 17 11:12:34 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 359/1069] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:12:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:12:36 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-053456f3-2962-45c4-a64d-d25f0545e601 req-76ef0a4e-257a-47b8-94ff-f3acf90b9769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c9d8d80-93ff-41f3-85c3-b2175b4532a9", "name": "network-vif-plugged", "status": "completed", "tag": "13f9efc6-6c46-418e-90e7-675a328c3d97"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:12:36 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-053456f3-2962-45c4-a64d-d25f0545e601 req-76ef0a4e-257a-47b8-94ff-f3acf90b9769 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:36 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-053456f3-2962-45c4-a64d-d25f0545e601 req-76ef0a4e-257a-47b8-94ff-f3acf90b9769 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:36 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-053456f3-2962-45c4-a64d-d25f0545e601 req-76ef0a4e-257a-47b8-94ff-f3acf90b9769 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:36 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-053456f3-2962-45c4-a64d-d25f0545e601 req-76ef0a4e-257a-47b8-94ff-f3acf90b9769 service nova] Creating event network-vif-plugged:13f9efc6-6c46-418e-90e7-675a328c3d97 for instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 on user Apr 17 11:12:36 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-053456f3-2962-45c4-a64d-d25f0545e601 req-76ef0a4e-257a-47b8-94ff-f3acf90b9769 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028554 Apr 17 11:12:36 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 366/1070] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:12:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:12:55 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=4 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:12:55 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:12:55 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:12:55 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-1b1c5770-b467-4fe3-8131-d7db2a65390f tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:12:55 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-1b1c5770-b467-4fe3-8131-d7db2a65390f tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 385a180f-e722-4826-a6e0-47608461e66e] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:12:55 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1b1c5770-b467-4fe3-8131-d7db2a65390f tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:55 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1b1c5770-b467-4fe3-8131-d7db2a65390f tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:55 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1b1c5770-b467-4fe3-8131-d7db2a65390f tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:55 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1b1c5770-b467-4fe3-8131-d7db2a65390f tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:55 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1b1c5770-b467-4fe3-8131-d7db2a65390f tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:55 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1b1c5770-b467-4fe3-8131-d7db2a65390f tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:55 user devstack@n-api.service[72744]: INFO nova.api.openstack.wsgi [None req-1b1c5770-b467-4fe3-8131-d7db2a65390f tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] HTTP exception thrown: Instance 385a180f-e722-4826-a6e0-47608461e66e could not be found. Apr 17 11:12:55 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-1b1c5770-b467-4fe3-8131-d7db2a65390f tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Request method failure captured: Apr 17 11:12:55 user devstack@n-api.service[72744]: request: GET /compute/v2.1/servers/385a180f-e722-4826-a6e0-47608461e66e HTTP/1.1 Apr 17 11:12:55 user devstack@n-api.service[72744]: Accept: application/json Apr 17 11:12:55 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 11:12:55 user devstack@n-api.service[72744]: Connection: close Apr 17 11:12:55 user devstack@n-api.service[72744]: Content-Length: 0 Apr 17 11:12:55 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 11:12:55 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 11:12:55 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 11:12:55 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 11:12:55 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSW-MrZeODEec0-GgKUVgcRRo9sR4IeW6R89M43QejliWYRYWbCdjzy6wRMS_cGtnxUrDzja9_DSrU_6Fw-WleIpEonGoJmFRMs8ds6cyemfdZByXsb2oi00E8GmlY0wlg6_XxhRgCWsYq5BBZzlT8hJjqZ7UMV7PuzjMaKmHClTbJ4 Apr 17 11:12:55 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 11:12:55 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 11:12:55 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 11:12:55 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 11:12:55 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 11:12:55 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 11:12:55 user devstack@n-api.service[72744]: X-Project-Id: 3747b7d3c6844772b0e6eed5299053ba Apr 17 11:12:55 user devstack@n-api.service[72744]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1988041396 Apr 17 11:12:55 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 11:12:55 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 11:12:55 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3747b7d3c6844772b0e6eed5299053ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3747b7d3c6844772b0e6eed5299053ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3747b7d3c6844772b0e6eed5299053ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:12:55 user devstack@n-api.service[72744]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1988041396 Apr 17 11:12:55 user devstack@n-api.service[72744]: X-Tenant-Id: 3747b7d3c6844772b0e6eed5299053ba Apr 17 11:12:55 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1988041396 Apr 17 11:12:55 user devstack@n-api.service[72744]: X-User: tempest-ServerRescueNegativeTestJSON-1988041396-project-member Apr 17 11:12:55 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 11:12:55 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 11:12:55 user devstack@n-api.service[72744]: X-User-Id: 30c15ce534a649ae8a971b33221e2500 Apr 17 11:12:55 user devstack@n-api.service[72744]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1988041396-project-member Apr 17 11:12:55 user devstack@n-api.service[72744]: method: > Apr 17 11:12:55 user devstack@n-api.service[72744]: exception: Instance 385a180f-e722-4826-a6e0-47608461e66e could not be found. Apr 17 11:12:55 user devstack@n-api.service[72744]: action_args: {'id': '385a180f-e722-4826-a6e0-47608461e66e'} Apr 17 11:12:55 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 385a180f-e722-4826-a6e0-47608461e66e could not be found. Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 385a180f-e722-4826-a6e0-47608461e66e could not be found. Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 385a180f-e722-4826-a6e0-47608461e66e could not be found. Apr 17 11:12:55 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:12:55 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-1b1c5770-b467-4fe3-8131-d7db2a65390f tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Returning 404 to user: Instance 385a180f-e722-4826-a6e0-47608461e66e could not be found. {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:12:55 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-1b1c5770-b467-4fe3-8131-d7db2a65390f tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/385a180f-e722-4826-a6e0-47608461e66e" status: 404 len: 111 microversion: 2.1 time: 0.151032 Apr 17 11:12:55 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 346/1071] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:12:55 2023] GET /compute/v2.1/servers/385a180f-e722-4826-a6e0-47608461e66e => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 17 11:12:55 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:12:55 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:12:55 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:12:55 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:12:55 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:12:55 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=4 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:12:55 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:55 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:55 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:55 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:55 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:55 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:55 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Going to try to terminate instance {{(pid=72743) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 11:12:55 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-e9b298fa-12b8-49b8-85bc-fef4c79a0aba tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" status: 204 len: 0 microversion: 2.1 time: 0.118918 Apr 17 11:12:55 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 360/1072] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 11:12:55 2023] DELETE /compute/v2.1/servers/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 11:12:55 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:12:55 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:12:55 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:12:55 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-f5b876a5-717f-4a72-98e4-d413c6e0688f tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:12:55 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-f5b876a5-717f-4a72-98e4-d413c6e0688f tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:12:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f5b876a5-717f-4a72-98e4-d413c6e0688f tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f5b876a5-717f-4a72-98e4-d413c6e0688f tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f5b876a5-717f-4a72-98e4-d413c6e0688f tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f5b876a5-717f-4a72-98e4-d413c6e0688f tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f5b876a5-717f-4a72-98e4-d413c6e0688f tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:55 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f5b876a5-717f-4a72-98e4-d413c6e0688f tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:55 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-c0bebf70-cb66-4668-aaf2-1b2c36510250 req-9147e9be-5ec6-424c-8892-e5531d9d0e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f", "name": "network-vif-unplugged", "status": "completed", "tag": "9c6c71a5-0190-4112-9044-5c238344dc88"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:12:55 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-f5b876a5-717f-4a72-98e4-d413c6e0688f tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c15ce534a649ae8a971b33221e2500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747b7d3c6844772b0e6eed5299053ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:12:55 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-c0bebf70-cb66-4668-aaf2-1b2c36510250 req-9147e9be-5ec6-424c-8892-e5531d9d0e88 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:55 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-c0bebf70-cb66-4668-aaf2-1b2c36510250 req-9147e9be-5ec6-424c-8892-e5531d9d0e88 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:55 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-c0bebf70-cb66-4668-aaf2-1b2c36510250 req-9147e9be-5ec6-424c-8892-e5531d9d0e88 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:55 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-f5b876a5-717f-4a72-98e4-d413c6e0688f tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" status: 200 len: 1509 microversion: 2.1 time: 0.233608 Apr 17 11:12:55 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 367/1073] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:12:55 2023] GET /compute/v2.1/servers/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f => generated 1509 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:12:55 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-c0bebf70-cb66-4668-aaf2-1b2c36510250 req-9147e9be-5ec6-424c-8892-e5531d9d0e88 service nova] Creating event network-vif-unplugged:9c6c71a5-0190-4112-9044-5c238344dc88 for instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f on user Apr 17 11:12:55 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-c0bebf70-cb66-4668-aaf2-1b2c36510250 req-9147e9be-5ec6-424c-8892-e5531d9d0e88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030937 Apr 17 11:12:55 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 347/1074] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:12:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:12:56 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-b5c509af-914b-4187-929e-dbef24c58920 req-504a26a8-0a1a-4a05-8a0e-be0c02f4a86e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f", "name": "network-vif-deleted", "tag": "9c6c71a5-0190-4112-9044-5c238344dc88"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:12:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-b5c509af-914b-4187-929e-dbef24c58920 req-504a26a8-0a1a-4a05-8a0e-be0c02f4a86e service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-b5c509af-914b-4187-929e-dbef24c58920 req-504a26a8-0a1a-4a05-8a0e-be0c02f4a86e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-b5c509af-914b-4187-929e-dbef24c58920 req-504a26a8-0a1a-4a05-8a0e-be0c02f4a86e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:56 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-b5c509af-914b-4187-929e-dbef24c58920 req-504a26a8-0a1a-4a05-8a0e-be0c02f4a86e service nova] Creating event network-vif-deleted:9c6c71a5-0190-4112-9044-5c238344dc88 for instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f on user Apr 17 11:12:56 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-b5c509af-914b-4187-929e-dbef24c58920 req-504a26a8-0a1a-4a05-8a0e-be0c02f4a86e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030273 Apr 17 11:12:56 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 361/1075] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:12:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:12:57 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-38968820-fa47-4ac1-aa9e-a3708e95a9dd req-6aa7ad7b-083d-418b-902a-4f30bd82cd4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f", "name": "network-vif-plugged", "status": "completed", "tag": "9c6c71a5-0190-4112-9044-5c238344dc88"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:12:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-38968820-fa47-4ac1-aa9e-a3708e95a9dd req-6aa7ad7b-083d-418b-902a-4f30bd82cd4b service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:12:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-38968820-fa47-4ac1-aa9e-a3708e95a9dd req-6aa7ad7b-083d-418b-902a-4f30bd82cd4b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:12:57 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-38968820-fa47-4ac1-aa9e-a3708e95a9dd req-6aa7ad7b-083d-418b-902a-4f30bd82cd4b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:12:57 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-38968820-fa47-4ac1-aa9e-a3708e95a9dd req-6aa7ad7b-083d-418b-902a-4f30bd82cd4b service nova] Creating event network-vif-plugged:9c6c71a5-0190-4112-9044-5c238344dc88 for instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f on user Apr 17 11:12:57 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-38968820-fa47-4ac1-aa9e-a3708e95a9dd req-6aa7ad7b-083d-418b-902a-4f30bd82cd4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027968 Apr 17 11:12:57 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 368/1076] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:12:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:13:19 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=4 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:13:19 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=4 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:13:19 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-e5c95861-e21d-45e5-a286-1042ef6abd63 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:13:19 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-e5c95861-e21d-45e5-a286-1042ef6abd63 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:13:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e5c95861-e21d-45e5-a286-1042ef6abd63 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:13:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e5c95861-e21d-45e5-a286-1042ef6abd63 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:13:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e5c95861-e21d-45e5-a286-1042ef6abd63 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:13:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e5c95861-e21d-45e5-a286-1042ef6abd63 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:13:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e5c95861-e21d-45e5-a286-1042ef6abd63 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:13:19 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e5c95861-e21d-45e5-a286-1042ef6abd63 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:13:20 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-e5c95861-e21d-45e5-a286-1042ef6abd63 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc272a75798487d84beedfa65775423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eccc3b86914e4ab735b79c4b53a142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:13:20 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-e5c95861-e21d-45e5-a286-1042ef6abd63 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c9d8d80-93ff-41f3-85c3-b2175b4532a9" status: 200 len: 1544 microversion: 2.1 time: 0.246817 Apr 17 11:13:20 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 348/1077] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:13:19 2023] GET /compute/v2.1/servers/6c9d8d80-93ff-41f3-85c3-b2175b4532a9 => generated 1544 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 17 11:13:45 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-389de32f-9c61-4f13-9b39-bd338a870880 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:13:45 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-389de32f-9c61-4f13-9b39-bd338a870880 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] [instance: 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:13:45 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:13:45 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:13:45 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-389de32f-9c61-4f13-9b39-bd338a870880 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:13:45 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-389de32f-9c61-4f13-9b39-bd338a870880 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:13:45 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-389de32f-9c61-4f13-9b39-bd338a870880 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:13:45 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-389de32f-9c61-4f13-9b39-bd338a870880 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:13:45 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-389de32f-9c61-4f13-9b39-bd338a870880 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:13:45 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-389de32f-9c61-4f13-9b39-bd338a870880 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:13:45 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-389de32f-9c61-4f13-9b39-bd338a870880 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] HTTP exception thrown: Instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f could not be found. Apr 17 11:13:45 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-389de32f-9c61-4f13-9b39-bd338a870880 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Request method failure captured: Apr 17 11:13:45 user devstack@n-api.service[72743]: request: GET /compute/v2.1/servers/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f HTTP/1.1 Apr 17 11:13:45 user devstack@n-api.service[72743]: Accept: application/json Apr 17 11:13:45 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 11:13:45 user devstack@n-api.service[72743]: Connection: close Apr 17 11:13:45 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 11:13:45 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 11:13:45 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 11:13:45 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 11:13:45 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 11:13:45 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSW-MrZeODEec0-GgKUVgcRRo9sR4IeW6R89M43QejliWYRYWbCdjzy6wRMS_cGtnxUrDzja9_DSrU_6Fw-WleIpEonGoJmFRMs8ds6cyemfdZByXsb2oi00E8GmlY0wlg6_XxhRgCWsYq5BBZzlT8hJjqZ7UMV7PuzjMaKmHClTbJ4 Apr 17 11:13:45 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 11:13:45 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 11:13:45 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 11:13:45 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 11:13:45 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 11:13:45 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 11:13:45 user devstack@n-api.service[72743]: X-Project-Id: 3747b7d3c6844772b0e6eed5299053ba Apr 17 11:13:45 user devstack@n-api.service[72743]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1988041396 Apr 17 11:13:45 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 11:13:45 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 11:13:45 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3747b7d3c6844772b0e6eed5299053ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3747b7d3c6844772b0e6eed5299053ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3747b7d3c6844772b0e6eed5299053ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:13:45 user devstack@n-api.service[72743]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1988041396 Apr 17 11:13:45 user devstack@n-api.service[72743]: X-Tenant-Id: 3747b7d3c6844772b0e6eed5299053ba Apr 17 11:13:45 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1988041396 Apr 17 11:13:45 user devstack@n-api.service[72743]: X-User: tempest-ServerRescueNegativeTestJSON-1988041396-project-member Apr 17 11:13:45 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 11:13:45 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 11:13:45 user devstack@n-api.service[72743]: X-User-Id: 30c15ce534a649ae8a971b33221e2500 Apr 17 11:13:45 user devstack@n-api.service[72743]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1988041396-project-member Apr 17 11:13:45 user devstack@n-api.service[72743]: method: > Apr 17 11:13:45 user devstack@n-api.service[72743]: exception: Instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f could not be found. Apr 17 11:13:45 user devstack@n-api.service[72743]: action_args: {'id': '06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f'} Apr 17 11:13:45 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f could not be found. Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f could not be found. Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f could not be found. Apr 17 11:13:45 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:13:45 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-389de32f-9c61-4f13-9b39-bd338a870880 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] Returning 404 to user: Instance 06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:13:45 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-389de32f-9c61-4f13-9b39-bd338a870880 tempest-ServerRescueNegativeTestJSON-1988041396 tempest-ServerRescueNegativeTestJSON-1988041396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f" status: 404 len: 111 microversion: 2.1 time: 0.044883 Apr 17 11:13:45 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 362/1078] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:13:45 2023] GET /compute/v2.1/servers/06d11b0f-8b76-4151-ad6d-ab4a5e7bae5f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 11:13:53 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=4 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:13:53 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=8 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:13:53 user devstack@n-api.service[72745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 17 11:13:53 user devstack@n-api.service[72745]: Mon Apr 17 11:13:53 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 17 11:13:53 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1694998313", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "networks": [{"uuid": "d9ffbb87-02a7-471a-befa-bd62b79a816d"}]}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:13:53 user devstack@n-api.service[72745]: DEBUG nova.network.neutron [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] validate_networks() for [('d9ffbb87-02a7-471a-befa-bd62b79a816d', None, None, None, None, None)] {{(pid=72745) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 11:13:53 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Flavor limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 11:13:53 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Image limits 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 11:13:53 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Flavor pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 11:13:53 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Image pref 0:0:0 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 11:13:53 user devstack@n-api.service[72745]: DEBUG nova.virt.hardware [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 11:13:53 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:13:53 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:13:53 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:13:53 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:13:53 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:13:53 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:13:53 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Getting quotas for project 44a166c75d3243199b27bfc1fe838615. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 11:13:53 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Getting quotas for user c994df66781047cd9fd114711b94606e and project 44a166c75d3243199b27bfc1fe838615. Resources: {'cores', 'instances', 'ram'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 11:13:53 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Going to run 1 instances... {{(pid=72745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 11:13:53 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 11:13:53 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-e47aee36-6435-489b-8903-4c6436208565 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.789091 Apr 17 11:13:53 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 369/1079] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 11:13:53 2023] POST /compute/v2.1/servers => generated 378 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 11:13:53 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-1b0a27e2-ec2b-4b3f-a214-2bd9641afc9d tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:13:53 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-1b0a27e2-ec2b-4b3f-a214-2bd9641afc9d tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:13:53 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:13:53 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:13:53 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-1b0a27e2-ec2b-4b3f-a214-2bd9641afc9d tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994df66781047cd9fd114711b94606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a166c75d3243199b27bfc1fe838615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:13:53 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-1b0a27e2-ec2b-4b3f-a214-2bd9641afc9d tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3fed4f97-8392-4f60-a0b5-c74f5100dbc4" status: 200 len: 1208 microversion: 2.1 time: 0.069868 Apr 17 11:13:53 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 349/1080] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:13:53 2023] GET /compute/v2.1/servers/3fed4f97-8392-4f60-a0b5-c74f5100dbc4 => generated 1208 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:13:56 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-41c4ddc7-0545-417d-b55f-f1d825588d30 req-abdb6048-fd52-478b-963d-c5814f74df08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fed4f97-8392-4f60-a0b5-c74f5100dbc4", "tag": "1e507e18-60cc-4d35-af55-72a252172e88"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:13:56 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:13:56 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:13:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-41c4ddc7-0545-417d-b55f-f1d825588d30 req-abdb6048-fd52-478b-963d-c5814f74df08 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:13:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-41c4ddc7-0545-417d-b55f-f1d825588d30 req-abdb6048-fd52-478b-963d-c5814f74df08 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:13:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-41c4ddc7-0545-417d-b55f-f1d825588d30 req-abdb6048-fd52-478b-963d-c5814f74df08 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:13:56 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-41c4ddc7-0545-417d-b55f-f1d825588d30 req-abdb6048-fd52-478b-963d-c5814f74df08 service nova] Creating event network-changed:1e507e18-60cc-4d35-af55-72a252172e88 for instance 3fed4f97-8392-4f60-a0b5-c74f5100dbc4 on user Apr 17 11:13:56 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-41c4ddc7-0545-417d-b55f-f1d825588d30 req-abdb6048-fd52-478b-963d-c5814f74df08 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034941 Apr 17 11:13:56 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 363/1081] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:13:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:13:58 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-e8f9da5e-c74e-4d71-943f-4ba2826302fa req-62dff9f8-50a2-477d-b925-502dde40a8b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fed4f97-8392-4f60-a0b5-c74f5100dbc4", "name": "network-vif-plugged", "status": "completed", "tag": "1e507e18-60cc-4d35-af55-72a252172e88"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:13:58 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-e8f9da5e-c74e-4d71-943f-4ba2826302fa req-62dff9f8-50a2-477d-b925-502dde40a8b4 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:13:58 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-e8f9da5e-c74e-4d71-943f-4ba2826302fa req-62dff9f8-50a2-477d-b925-502dde40a8b4 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:13:58 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-e8f9da5e-c74e-4d71-943f-4ba2826302fa req-62dff9f8-50a2-477d-b925-502dde40a8b4 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:13:58 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-e8f9da5e-c74e-4d71-943f-4ba2826302fa req-62dff9f8-50a2-477d-b925-502dde40a8b4 service nova] Creating event network-vif-plugged:1e507e18-60cc-4d35-af55-72a252172e88 for instance 3fed4f97-8392-4f60-a0b5-c74f5100dbc4 on user Apr 17 11:13:58 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-e8f9da5e-c74e-4d71-943f-4ba2826302fa req-62dff9f8-50a2-477d-b925-502dde40a8b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028340 Apr 17 11:13:58 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 370/1082] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:13:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:14:00 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-7f04faf2-b19b-4962-8f70-1301cde413f6 req-7938a2a5-7d1f-40c8-8772-0a598c9631bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fed4f97-8392-4f60-a0b5-c74f5100dbc4", "name": "network-vif-plugged", "status": "completed", "tag": "1e507e18-60cc-4d35-af55-72a252172e88"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:14:00 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-7f04faf2-b19b-4962-8f70-1301cde413f6 req-7938a2a5-7d1f-40c8-8772-0a598c9631bb service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:14:00 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-7f04faf2-b19b-4962-8f70-1301cde413f6 req-7938a2a5-7d1f-40c8-8772-0a598c9631bb service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:14:00 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-7f04faf2-b19b-4962-8f70-1301cde413f6 req-7938a2a5-7d1f-40c8-8772-0a598c9631bb service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:14:00 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-7f04faf2-b19b-4962-8f70-1301cde413f6 req-7938a2a5-7d1f-40c8-8772-0a598c9631bb service nova] Creating event network-vif-plugged:1e507e18-60cc-4d35-af55-72a252172e88 for instance 3fed4f97-8392-4f60-a0b5-c74f5100dbc4 on user Apr 17 11:14:00 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-7f04faf2-b19b-4962-8f70-1301cde413f6 req-7938a2a5-7d1f-40c8-8772-0a598c9631bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032198 Apr 17 11:14:00 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 350/1083] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:14:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:14:20 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:14:20 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:14:20 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-f992c949-076c-4843-b640-c0769a36f09e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:14:20 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-f992c949-076c-4843-b640-c0769a36f09e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:14:20 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f992c949-076c-4843-b640-c0769a36f09e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:14:20 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f992c949-076c-4843-b640-c0769a36f09e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:14:20 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f992c949-076c-4843-b640-c0769a36f09e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:14:20 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f992c949-076c-4843-b640-c0769a36f09e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:14:20 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f992c949-076c-4843-b640-c0769a36f09e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:14:20 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f992c949-076c-4843-b640-c0769a36f09e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:14:20 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-f992c949-076c-4843-b640-c0769a36f09e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c9d8d80-93ff-41f3-85c3-b2175b4532a9/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.163096 Apr 17 11:14:20 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 364/1084] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 17 11:14:20 2023] GET /compute/v2.1/servers/6c9d8d80-93ff-41f3-85c3-b2175b4532a9/os-interface => generated 283 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 11:14:21 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:14:21 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:14:21 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:14:21 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=4 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:14:21 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-8b005557-0598-4641-b5ff-e0a5b1420be7 req-89a76a79-2236-4026-b64b-d05e43c9d223 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c9d8d80-93ff-41f3-85c3-b2175b4532a9", "tag": "13f9efc6-6c46-418e-90e7-675a328c3d97"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:14:21 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-8b005557-0598-4641-b5ff-e0a5b1420be7 req-89a76a79-2236-4026-b64b-d05e43c9d223 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:14:21 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-8b005557-0598-4641-b5ff-e0a5b1420be7 req-89a76a79-2236-4026-b64b-d05e43c9d223 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:14:21 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-8b005557-0598-4641-b5ff-e0a5b1420be7 req-89a76a79-2236-4026-b64b-d05e43c9d223 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:14:21 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-8b005557-0598-4641-b5ff-e0a5b1420be7 req-89a76a79-2236-4026-b64b-d05e43c9d223 service nova] Creating event network-changed:13f9efc6-6c46-418e-90e7-675a328c3d97 for instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 on user Apr 17 11:14:21 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-8b005557-0598-4641-b5ff-e0a5b1420be7 req-89a76a79-2236-4026-b64b-d05e43c9d223 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041475 Apr 17 11:14:21 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 371/1085] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:14:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:14:21 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:14:21 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:14:21 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:14:21 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-56ced0e1-9df4-4f66-8b77-77f8a6626c60 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:14:21 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-56ced0e1-9df4-4f66-8b77-77f8a6626c60 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:14:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-56ced0e1-9df4-4f66-8b77-77f8a6626c60 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:14:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-56ced0e1-9df4-4f66-8b77-77f8a6626c60 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:14:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-56ced0e1-9df4-4f66-8b77-77f8a6626c60 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:14:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-56ced0e1-9df4-4f66-8b77-77f8a6626c60 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:14:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-56ced0e1-9df4-4f66-8b77-77f8a6626c60 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:14:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-56ced0e1-9df4-4f66-8b77-77f8a6626c60 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:14:21 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-56ced0e1-9df4-4f66-8b77-77f8a6626c60 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c9d8d80-93ff-41f3-85c3-b2175b4532a9/ips" status: 200 len: 108 microversion: 2.1 time: 0.047595 Apr 17 11:14:21 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 351/1086] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 17 11:14:21 2023] GET /compute/v2.1/servers/6c9d8d80-93ff-41f3-85c3-b2175b4532a9/ips => generated 108 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:14:21 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-4e5b3e37-b2bd-4303-94d9-c9a1a6f6f44b tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3bcd996-c073-4475-8cd0-b64ef67190b5"}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:14:21 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-4e5b3e37-b2bd-4303-94d9-c9a1a6f6f44b tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:14:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4e5b3e37-b2bd-4303-94d9-c9a1a6f6f44b tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:14:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4e5b3e37-b2bd-4303-94d9-c9a1a6f6f44b tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:14:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4e5b3e37-b2bd-4303-94d9-c9a1a6f6f44b tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:14:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4e5b3e37-b2bd-4303-94d9-c9a1a6f6f44b tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:14:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4e5b3e37-b2bd-4303-94d9-c9a1a6f6f44b tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:14:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4e5b3e37-b2bd-4303-94d9-c9a1a6f6f44b tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:14:21 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-4e5b3e37-b2bd-4303-94d9-c9a1a6f6f44b tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] HTTP exception thrown: Invalid volume: volume e3bcd996-c073-4475-8cd0-b64ef67190b5 is already attached to instances: 027f1645-6991-4726-b1f4-2728db710061 Apr 17 11:14:21 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-4e5b3e37-b2bd-4303-94d9-c9a1a6f6f44b tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Request method failure captured: Apr 17 11:14:21 user devstack@n-api.service[72743]: request: POST /compute/v2.1/servers/6c9d8d80-93ff-41f3-85c3-b2175b4532a9/os-volume_attachments HTTP/1.1 Apr 17 11:14:21 user devstack@n-api.service[72743]: Accept: application/json Apr 17 11:14:21 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 11:14:21 user devstack@n-api.service[72743]: Connection: close Apr 17 11:14:21 user devstack@n-api.service[72743]: Content-Length: 74 Apr 17 11:14:21 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 11:14:21 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 11:14:21 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 11:14:21 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 11:14:21 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSkdNQlCQC0j_Scqt663u25JTKQ0VvHFR-Bs1WS4w1fclhhIe3uhdCjhS0GOk8WnVkAutnR7qqfJWjiB6gcAQZ5DHL7aRU3t4toaBkIvfpzRhhQyd8nAqMW--pdlYU2PLeANHC09fvmgTb5gEfrAhofFPyP8HzlyOsNLSJt_SNIjKTc Apr 17 11:14:21 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 11:14:21 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 11:14:21 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 11:14:21 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 11:14:21 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 11:14:21 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 11:14:21 user devstack@n-api.service[72743]: X-Project-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:14:21 user devstack@n-api.service[72743]: X-Project-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:14:21 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 11:14:21 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 11:14:21 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:14:21 user devstack@n-api.service[72743]: X-Tenant: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:14:21 user devstack@n-api.service[72743]: X-Tenant-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:14:21 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:14:21 user devstack@n-api.service[72743]: X-User: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:14:21 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 11:14:21 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 11:14:21 user devstack@n-api.service[72743]: X-User-Id: 8fc272a75798487d84beedfa65775423 Apr 17 11:14:21 user devstack@n-api.service[72743]: X-User-Name: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:14:21 user devstack@n-api.service[72743]: Apr 17 11:14:21 user devstack@n-api.service[72743]: {"volumeAttachment": {"volumeId": "e3bcd996-c073-4475-8cd0-b64ef67190b5"}} Apr 17 11:14:21 user devstack@n-api.service[72743]: method: > Apr 17 11:14:21 user devstack@n-api.service[72743]: exception: Invalid volume: volume e3bcd996-c073-4475-8cd0-b64ef67190b5 is already attached to instances: 027f1645-6991-4726-b1f4-2728db710061 Apr 17 11:14:21 user devstack@n-api.service[72743]: action_args: {'server_id': '6c9d8d80-93ff-41f3-85c3-b2175b4532a9', 'body': {'volumeAttachment': {'volumeId': 'e3bcd996-c073-4475-8cd0-b64ef67190b5'}}} Apr 17 11:14:21 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e3bcd996-c073-4475-8cd0-b64ef67190b5 is already attached to instances: 027f1645-6991-4726-b1f4-2728db710061 Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e3bcd996-c073-4475-8cd0-b64ef67190b5 is already attached to instances: 027f1645-6991-4726-b1f4-2728db710061 Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e3bcd996-c073-4475-8cd0-b64ef67190b5 is already attached to instances: 027f1645-6991-4726-b1f4-2728db710061 Apr 17 11:14:21 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:14:21 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-4e5b3e37-b2bd-4303-94d9-c9a1a6f6f44b tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Returning 400 to user: Invalid volume: volume e3bcd996-c073-4475-8cd0-b64ef67190b5 is already attached to instances: 027f1645-6991-4726-b1f4-2728db710061 {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:14:21 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-4e5b3e37-b2bd-4303-94d9-c9a1a6f6f44b tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6c9d8d80-93ff-41f3-85c3-b2175b4532a9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100749 Apr 17 11:14:21 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 365/1087] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Apr 17 11:14:21 2023] POST /compute/v2.1/servers/6c9d8d80-93ff-41f3-85c3-b2175b4532a9/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 17 11:14:21 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:14:21 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:14:21 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:14:21 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:14:21 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:14:21 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:14:21 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:14:21 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:14:21 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Going to try to terminate instance {{(pid=72745) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 11:14:21 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-ced0028d-b9c6-4f42-8498-4c3fc6c6c983 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6c9d8d80-93ff-41f3-85c3-b2175b4532a9" status: 204 len: 0 microversion: 2.1 time: 0.119189 Apr 17 11:14:21 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 372/1088] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 11:14:21 2023] DELETE /compute/v2.1/servers/6c9d8d80-93ff-41f3-85c3-b2175b4532a9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 11:14:21 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-249e084e-92f7-48bc-9c85-080dbad63261 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:14:21 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-249e084e-92f7-48bc-9c85-080dbad63261 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:14:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-249e084e-92f7-48bc-9c85-080dbad63261 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:14:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-249e084e-92f7-48bc-9c85-080dbad63261 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:14:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-249e084e-92f7-48bc-9c85-080dbad63261 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:14:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-249e084e-92f7-48bc-9c85-080dbad63261 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:14:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-249e084e-92f7-48bc-9c85-080dbad63261 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:14:21 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-249e084e-92f7-48bc-9c85-080dbad63261 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:14:21 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-249e084e-92f7-48bc-9c85-080dbad63261 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc272a75798487d84beedfa65775423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eccc3b86914e4ab735b79c4b53a142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:14:21 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-249e084e-92f7-48bc-9c85-080dbad63261 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c9d8d80-93ff-41f3-85c3-b2175b4532a9" status: 200 len: 1550 microversion: 2.1 time: 0.256886 Apr 17 11:14:21 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 352/1089] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:14:21 2023] GET /compute/v2.1/servers/6c9d8d80-93ff-41f3-85c3-b2175b4532a9 => generated 1550 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:14:21 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-3db2eabd-e903-443f-bc87-2e95590ed3bf req-bfe0ee4f-c44a-4717-9c66-a02f28f6b550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c9d8d80-93ff-41f3-85c3-b2175b4532a9", "name": "network-vif-unplugged", "status": "completed", "tag": "13f9efc6-6c46-418e-90e7-675a328c3d97"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:14:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-3db2eabd-e903-443f-bc87-2e95590ed3bf req-bfe0ee4f-c44a-4717-9c66-a02f28f6b550 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:14:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-3db2eabd-e903-443f-bc87-2e95590ed3bf req-bfe0ee4f-c44a-4717-9c66-a02f28f6b550 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:14:21 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-3db2eabd-e903-443f-bc87-2e95590ed3bf req-bfe0ee4f-c44a-4717-9c66-a02f28f6b550 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:14:21 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-3db2eabd-e903-443f-bc87-2e95590ed3bf req-bfe0ee4f-c44a-4717-9c66-a02f28f6b550 service nova] Creating event network-vif-unplugged:13f9efc6-6c46-418e-90e7-675a328c3d97 for instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 on user Apr 17 11:14:21 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-3db2eabd-e903-443f-bc87-2e95590ed3bf req-bfe0ee4f-c44a-4717-9c66-a02f28f6b550 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089493 Apr 17 11:14:21 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 366/1090] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:14:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:14:23 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-8d063cec-0eb5-49a5-b9dc-f6c76e5e4394 req-8af32cf7-d4cd-4c71-b3a2-9d6a11ae598a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c9d8d80-93ff-41f3-85c3-b2175b4532a9", "name": "network-vif-deleted", "tag": "13f9efc6-6c46-418e-90e7-675a328c3d97"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:14:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-8d063cec-0eb5-49a5-b9dc-f6c76e5e4394 req-8af32cf7-d4cd-4c71-b3a2-9d6a11ae598a service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:14:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-8d063cec-0eb5-49a5-b9dc-f6c76e5e4394 req-8af32cf7-d4cd-4c71-b3a2-9d6a11ae598a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:14:23 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-8d063cec-0eb5-49a5-b9dc-f6c76e5e4394 req-8af32cf7-d4cd-4c71-b3a2-9d6a11ae598a service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:14:23 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-8d063cec-0eb5-49a5-b9dc-f6c76e5e4394 req-8af32cf7-d4cd-4c71-b3a2-9d6a11ae598a service nova] Creating event network-vif-deleted:13f9efc6-6c46-418e-90e7-675a328c3d97 for instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 on user Apr 17 11:14:23 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-8d063cec-0eb5-49a5-b9dc-f6c76e5e4394 req-8af32cf7-d4cd-4c71-b3a2-9d6a11ae598a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029790 Apr 17 11:14:23 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 373/1091] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:14:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:14:23 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c9d8d80-93ff-41f3-85c3-b2175b4532a9", "name": "network-vif-plugged", "status": "completed", "tag": "13f9efc6-6c46-418e-90e7-675a328c3d97"}, {"server_uuid": "6c9d8d80-93ff-41f3-85c3-b2175b4532a9", "name": "network-vif-plugged", "status": "completed", "tag": "13f9efc6-6c46-418e-90e7-675a328c3d97"}, {"server_uuid": "6c9d8d80-93ff-41f3-85c3-b2175b4532a9", "name": "network-vif-plugged", "status": "completed", "tag": "13f9efc6-6c46-418e-90e7-675a328c3d97"}, {"server_uuid": "6c9d8d80-93ff-41f3-85c3-b2175b4532a9", "name": "network-vif-plugged", "status": "completed", "tag": "13f9efc6-6c46-418e-90e7-675a328c3d97"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:14:23 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:14:23 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:14:23 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:14:23 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] Creating event network-vif-plugged:13f9efc6-6c46-418e-90e7-675a328c3d97 for instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 on user Apr 17 11:14:23 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] Creating event network-vif-plugged:13f9efc6-6c46-418e-90e7-675a328c3d97 for instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 on user Apr 17 11:14:23 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] Creating event network-vif-plugged:13f9efc6-6c46-418e-90e7-675a328c3d97 for instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 on user Apr 17 11:14:23 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] Creating event network-vif-plugged:13f9efc6-6c46-418e-90e7-675a328c3d97 for instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 on user Apr 17 11:14:23 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-ef07a63a-45f6-428c-bf52-2be64d418ec2 req-90de0ce6-f160-4e96-b4e1-e5d9e06bd40f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.031758 Apr 17 11:14:23 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 353/1092] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:14:23 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:14:44 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-476412fa-a28b-4a2b-a2cd-7a47c99915d6 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:14:44 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-476412fa-a28b-4a2b-a2cd-7a47c99915d6 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:14:44 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:14:44 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=12 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:14:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-476412fa-a28b-4a2b-a2cd-7a47c99915d6 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:14:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-476412fa-a28b-4a2b-a2cd-7a47c99915d6 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:14:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-476412fa-a28b-4a2b-a2cd-7a47c99915d6 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:14:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-476412fa-a28b-4a2b-a2cd-7a47c99915d6 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:14:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-476412fa-a28b-4a2b-a2cd-7a47c99915d6 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:14:44 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-476412fa-a28b-4a2b-a2cd-7a47c99915d6 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:14:44 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-476412fa-a28b-4a2b-a2cd-7a47c99915d6 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994df66781047cd9fd114711b94606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a166c75d3243199b27bfc1fe838615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:14:44 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-476412fa-a28b-4a2b-a2cd-7a47c99915d6 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3fed4f97-8392-4f60-a0b5-c74f5100dbc4" status: 200 len: 1485 microversion: 2.1 time: 0.251368 Apr 17 11:14:44 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 367/1093] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:14:44 2023] GET /compute/v2.1/servers/3fed4f97-8392-4f60-a0b5-c74f5100dbc4 => generated 1485 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:15:11 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:15:11 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:15:11 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-15dc4172-d697-49b9-a394-3ad0d0a1907a tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:15:11 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-15dc4172-d697-49b9-a394-3ad0d0a1907a tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:15:11 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-15dc4172-d697-49b9-a394-3ad0d0a1907a tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:15:11 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-15dc4172-d697-49b9-a394-3ad0d0a1907a tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:15:11 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-15dc4172-d697-49b9-a394-3ad0d0a1907a tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:15:11 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-15dc4172-d697-49b9-a394-3ad0d0a1907a tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:15:11 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-15dc4172-d697-49b9-a394-3ad0d0a1907a tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:15:11 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-15dc4172-d697-49b9-a394-3ad0d0a1907a tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:15:11 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-15dc4172-d697-49b9-a394-3ad0d0a1907a tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] HTTP exception thrown: Instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 could not be found. Apr 17 11:15:11 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-15dc4172-d697-49b9-a394-3ad0d0a1907a tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Request method failure captured: Apr 17 11:15:11 user devstack@n-api.service[72745]: request: GET /compute/v2.1/servers/6c9d8d80-93ff-41f3-85c3-b2175b4532a9 HTTP/1.1 Apr 17 11:15:11 user devstack@n-api.service[72745]: Accept: application/json Apr 17 11:15:11 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 11:15:11 user devstack@n-api.service[72745]: Connection: close Apr 17 11:15:11 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 11:15:11 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 11:15:11 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 11:15:11 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 11:15:11 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 11:15:11 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSkdNQlCQC0j_Scqt663u25JTKQ0VvHFR-Bs1WS4w1fclhhIe3uhdCjhS0GOk8WnVkAutnR7qqfJWjiB6gcAQZ5DHL7aRU3t4toaBkIvfpzRhhQyd8nAqMW--pdlYU2PLeANHC09fvmgTb5gEfrAhofFPyP8HzlyOsNLSJt_SNIjKTc Apr 17 11:15:11 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 11:15:11 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 11:15:11 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 11:15:11 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 11:15:11 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 11:15:11 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 11:15:11 user devstack@n-api.service[72745]: X-Project-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:15:11 user devstack@n-api.service[72745]: X-Project-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:15:11 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 11:15:11 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 11:15:11 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:15:11 user devstack@n-api.service[72745]: X-Tenant: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:15:11 user devstack@n-api.service[72745]: X-Tenant-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:15:11 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:15:11 user devstack@n-api.service[72745]: X-User: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:15:11 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 11:15:11 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 11:15:11 user devstack@n-api.service[72745]: X-User-Id: 8fc272a75798487d84beedfa65775423 Apr 17 11:15:11 user devstack@n-api.service[72745]: X-User-Name: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:15:11 user devstack@n-api.service[72745]: method: > Apr 17 11:15:11 user devstack@n-api.service[72745]: exception: Instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 could not be found. Apr 17 11:15:11 user devstack@n-api.service[72745]: action_args: {'id': '6c9d8d80-93ff-41f3-85c3-b2175b4532a9'} Apr 17 11:15:11 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 could not be found. Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 could not be found. Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 could not be found. Apr 17 11:15:11 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:15:11 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-15dc4172-d697-49b9-a394-3ad0d0a1907a tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Returning 404 to user: Instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:15:11 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-15dc4172-d697-49b9-a394-3ad0d0a1907a tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c9d8d80-93ff-41f3-85c3-b2175b4532a9" status: 404 len: 111 microversion: 2.1 time: 0.086072 Apr 17 11:15:11 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 374/1094] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:15:11 2023] GET /compute/v2.1/servers/6c9d8d80-93ff-41f3-85c3-b2175b4532a9 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 11:15:11 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:15:11 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=12 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:15:11 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-5c27db6d-3329-4ebc-8f8d-5f777e7779a0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '.version_select at 0x7fc55acd16c0>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:15:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-5c27db6d-3329-4ebc-8f8d-5f777e7779a0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1860561692" status: 202 len: 0 microversion: 2.1 time: 0.036261 Apr 17 11:15:11 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 354/1095] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Apr 17 11:15:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1860561692 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 11:15:12 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:15:12 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:15:12 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:15:12 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:15:12 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:15:12 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:15:12 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:15:12 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:15:12 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:15:12 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:15:12 user devstack@n-api.service[72743]: DEBUG nova.objects.instance [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lazy-loading 'services' on Instance uuid 027f1645-6991-4726-b1f4-2728db710061 {{(pid=72743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 11:15:12 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-e3e65e4e-2583-4aba-8596-c79b5e9f5bea tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061/os-volume_attachments/e3bcd996-c073-4475-8cd0-b64ef67190b5" status: 202 len: 0 microversion: 2.1 time: 0.175931 Apr 17 11:15:12 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 368/1096] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Apr 17 11:15:12 2023] DELETE /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061/os-volume_attachments/e3bcd996-c073-4475-8cd0-b64ef67190b5 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 11:15:12 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-4af8f277-fa79-41f8-9fdb-dd6134706c37 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:15:12 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-4af8f277-fa79-41f8-9fdb-dd6134706c37 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:15:12 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4af8f277-fa79-41f8-9fdb-dd6134706c37 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:15:12 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4af8f277-fa79-41f8-9fdb-dd6134706c37 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:15:12 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4af8f277-fa79-41f8-9fdb-dd6134706c37 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:15:12 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4af8f277-fa79-41f8-9fdb-dd6134706c37 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:15:12 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4af8f277-fa79-41f8-9fdb-dd6134706c37 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:15:12 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-4af8f277-fa79-41f8-9fdb-dd6134706c37 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:15:12 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-4af8f277-fa79-41f8-9fdb-dd6134706c37 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068949 Apr 17 11:15:12 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 375/1097] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 11:15:12 2023] GET /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:15:51 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:15:51 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:15:51 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:15:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:15:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:15:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:15:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:15:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:15:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:15:51 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Going to try to terminate instance {{(pid=72744) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 11:15:51 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-f781734b-b170-4856-9730-e181e2664524 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3fed4f97-8392-4f60-a0b5-c74f5100dbc4" status: 204 len: 0 microversion: 2.1 time: 0.125898 Apr 17 11:15:51 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 355/1098] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 11:15:51 2023] DELETE /compute/v2.1/servers/3fed4f97-8392-4f60-a0b5-c74f5100dbc4 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 11:15:51 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:15:51 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:15:51 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-02a27bad-6fb9-4b1c-b24e-5b25bd0bde62 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:15:51 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-02a27bad-6fb9-4b1c-b24e-5b25bd0bde62 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:15:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-02a27bad-6fb9-4b1c-b24e-5b25bd0bde62 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:15:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-02a27bad-6fb9-4b1c-b24e-5b25bd0bde62 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:15:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-02a27bad-6fb9-4b1c-b24e-5b25bd0bde62 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:15:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-02a27bad-6fb9-4b1c-b24e-5b25bd0bde62 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:15:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-02a27bad-6fb9-4b1c-b24e-5b25bd0bde62 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:15:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-02a27bad-6fb9-4b1c-b24e-5b25bd0bde62 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:15:51 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-a8f7471b-e2c8-4ee9-a610-9f759ef8ceaa req-1883d45d-fd08-4199-8da8-9054cb94b41f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fed4f97-8392-4f60-a0b5-c74f5100dbc4", "name": "network-vif-unplugged", "status": "completed", "tag": "1e507e18-60cc-4d35-af55-72a252172e88"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:15:51 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=4 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:15:51 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=8 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:15:51 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-a8f7471b-e2c8-4ee9-a610-9f759ef8ceaa req-1883d45d-fd08-4199-8da8-9054cb94b41f service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:15:51 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-a8f7471b-e2c8-4ee9-a610-9f759ef8ceaa req-1883d45d-fd08-4199-8da8-9054cb94b41f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:15:51 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-a8f7471b-e2c8-4ee9-a610-9f759ef8ceaa req-1883d45d-fd08-4199-8da8-9054cb94b41f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:15:51 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-a8f7471b-e2c8-4ee9-a610-9f759ef8ceaa req-1883d45d-fd08-4199-8da8-9054cb94b41f service nova] Creating event network-vif-unplugged:1e507e18-60cc-4d35-af55-72a252172e88 for instance 3fed4f97-8392-4f60-a0b5-c74f5100dbc4 on user Apr 17 11:15:51 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-a8f7471b-e2c8-4ee9-a610-9f759ef8ceaa req-1883d45d-fd08-4199-8da8-9054cb94b41f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038925 Apr 17 11:15:51 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 376/1099] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:15:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:15:51 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-02a27bad-6fb9-4b1c-b24e-5b25bd0bde62 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994df66781047cd9fd114711b94606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a166c75d3243199b27bfc1fe838615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:15:51 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-02a27bad-6fb9-4b1c-b24e-5b25bd0bde62 tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3fed4f97-8392-4f60-a0b5-c74f5100dbc4" status: 200 len: 1491 microversion: 2.1 time: 0.504184 Apr 17 11:15:51 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 369/1100] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:15:51 2023] GET /compute/v2.1/servers/3fed4f97-8392-4f60-a0b5-c74f5100dbc4 => generated 1491 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:15:53 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-48c09e01-64db-4ccc-a261-7f40993b9019 req-082315be-8fc8-446a-9c1d-5ad5461026bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fed4f97-8392-4f60-a0b5-c74f5100dbc4", "name": "network-vif-plugged", "status": "completed", "tag": "1e507e18-60cc-4d35-af55-72a252172e88"}, {"server_uuid": "3fed4f97-8392-4f60-a0b5-c74f5100dbc4", "name": "network-vif-deleted", "tag": "1e507e18-60cc-4d35-af55-72a252172e88"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:15:53 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-48c09e01-64db-4ccc-a261-7f40993b9019 req-082315be-8fc8-446a-9c1d-5ad5461026bd service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:15:53 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-48c09e01-64db-4ccc-a261-7f40993b9019 req-082315be-8fc8-446a-9c1d-5ad5461026bd service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:15:53 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-48c09e01-64db-4ccc-a261-7f40993b9019 req-082315be-8fc8-446a-9c1d-5ad5461026bd service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:15:53 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-48c09e01-64db-4ccc-a261-7f40993b9019 req-082315be-8fc8-446a-9c1d-5ad5461026bd service nova] Creating event network-vif-plugged:1e507e18-60cc-4d35-af55-72a252172e88 for instance 3fed4f97-8392-4f60-a0b5-c74f5100dbc4 on user Apr 17 11:15:53 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-48c09e01-64db-4ccc-a261-7f40993b9019 req-082315be-8fc8-446a-9c1d-5ad5461026bd service nova] Creating event network-vif-deleted:1e507e18-60cc-4d35-af55-72a252172e88 for instance 3fed4f97-8392-4f60-a0b5-c74f5100dbc4 on user Apr 17 11:15:53 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-48c09e01-64db-4ccc-a261-7f40993b9019 req-082315be-8fc8-446a-9c1d-5ad5461026bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031224 Apr 17 11:15:53 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 356/1101] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:15:53 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:16:02 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:16:02 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:16:03 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-14ac28e6-1894-48ef-bfbf-41d8597bcea3 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:16:03 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-14ac28e6-1894-48ef-bfbf-41d8597bcea3 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:16:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-14ac28e6-1894-48ef-bfbf-41d8597bcea3 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:16:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-14ac28e6-1894-48ef-bfbf-41d8597bcea3 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:16:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-14ac28e6-1894-48ef-bfbf-41d8597bcea3 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:16:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-14ac28e6-1894-48ef-bfbf-41d8597bcea3 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:16:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-14ac28e6-1894-48ef-bfbf-41d8597bcea3 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:16:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-14ac28e6-1894-48ef-bfbf-41d8597bcea3 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:16:03 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-14ac28e6-1894-48ef-bfbf-41d8597bcea3 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.147635 Apr 17 11:16:03 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 377/1102] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 11:16:02 2023] GET /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061/os-volume_attachments => generated 25 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 17 11:16:03 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:16:03 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:16:03 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:16:03 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:16:03 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:16:03 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:16:03 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:16:03 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:16:03 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:16:03 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:16:03 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Going to try to terminate instance {{(pid=72743) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 11:16:03 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-4950351a-df27-4699-894d-0c8407a8392e tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061" status: 204 len: 0 microversion: 2.1 time: 0.114624 Apr 17 11:16:03 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 370/1103] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 11:16:03 2023] DELETE /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 11:16:03 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-151c689e-4277-4fbd-8d2b-4ac3fd353a62 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:16:03 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-151c689e-4277-4fbd-8d2b-4ac3fd353a62 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:16:03 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-151c689e-4277-4fbd-8d2b-4ac3fd353a62 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:16:03 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-151c689e-4277-4fbd-8d2b-4ac3fd353a62 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:16:03 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-151c689e-4277-4fbd-8d2b-4ac3fd353a62 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:16:03 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-151c689e-4277-4fbd-8d2b-4ac3fd353a62 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:16:03 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-151c689e-4277-4fbd-8d2b-4ac3fd353a62 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:16:03 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-151c689e-4277-4fbd-8d2b-4ac3fd353a62 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:16:03 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-151c689e-4277-4fbd-8d2b-4ac3fd353a62 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc272a75798487d84beedfa65775423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eccc3b86914e4ab735b79c4b53a142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:16:03 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-151c689e-4277-4fbd-8d2b-4ac3fd353a62 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061" status: 200 len: 1669 microversion: 2.1 time: 0.238932 Apr 17 11:16:03 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 357/1104] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:16:03 2023] GET /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061 => generated 1669 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:16:03 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-ca3e719c-8a64-421c-aeb6-f75e4ba018ed req-e09f88a0-071b-409a-9286-f3d521f76705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "027f1645-6991-4726-b1f4-2728db710061", "name": "network-vif-unplugged", "status": "completed", "tag": "8c280312-1554-4ee3-aadd-aa4929fecbda"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:16:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-ca3e719c-8a64-421c-aeb6-f75e4ba018ed req-e09f88a0-071b-409a-9286-f3d521f76705 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:16:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-ca3e719c-8a64-421c-aeb6-f75e4ba018ed req-e09f88a0-071b-409a-9286-f3d521f76705 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:16:03 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-ca3e719c-8a64-421c-aeb6-f75e4ba018ed req-e09f88a0-071b-409a-9286-f3d521f76705 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:16:03 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-ca3e719c-8a64-421c-aeb6-f75e4ba018ed req-e09f88a0-071b-409a-9286-f3d521f76705 service nova] Creating event network-vif-unplugged:8c280312-1554-4ee3-aadd-aa4929fecbda for instance 027f1645-6991-4726-b1f4-2728db710061 on user Apr 17 11:16:04 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-ca3e719c-8a64-421c-aeb6-f75e4ba018ed req-e09f88a0-071b-409a-9286-f3d521f76705 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084209 Apr 17 11:16:04 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 378/1105] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:16:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:16:04 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-21eb3281-94e7-44a0-a7eb-7ed22091ca14 req-a5fbcdb2-64cc-469c-99f8-70285da49be5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "027f1645-6991-4726-b1f4-2728db710061", "name": "network-vif-deleted", "tag": "8c280312-1554-4ee3-aadd-aa4929fecbda"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:16:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-21eb3281-94e7-44a0-a7eb-7ed22091ca14 req-a5fbcdb2-64cc-469c-99f8-70285da49be5 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:16:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-21eb3281-94e7-44a0-a7eb-7ed22091ca14 req-a5fbcdb2-64cc-469c-99f8-70285da49be5 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:16:04 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-21eb3281-94e7-44a0-a7eb-7ed22091ca14 req-a5fbcdb2-64cc-469c-99f8-70285da49be5 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:16:04 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-21eb3281-94e7-44a0-a7eb-7ed22091ca14 req-a5fbcdb2-64cc-469c-99f8-70285da49be5 service nova] Creating event network-vif-deleted:8c280312-1554-4ee3-aadd-aa4929fecbda for instance 027f1645-6991-4726-b1f4-2728db710061 on user Apr 17 11:16:04 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-21eb3281-94e7-44a0-a7eb-7ed22091ca14 req-a5fbcdb2-64cc-469c-99f8-70285da49be5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031681 Apr 17 11:16:04 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 371/1106] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:16:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:16:06 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-f4560bf9-cddb-4b59-a71e-c4774b7af3d9 req-83a2f71e-f232-4eb2-97cd-f2eb4dd80d43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "027f1645-6991-4726-b1f4-2728db710061", "name": "network-vif-plugged", "status": "completed", "tag": "8c280312-1554-4ee3-aadd-aa4929fecbda"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:16:06 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-f4560bf9-cddb-4b59-a71e-c4774b7af3d9 req-83a2f71e-f232-4eb2-97cd-f2eb4dd80d43 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:16:06 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-f4560bf9-cddb-4b59-a71e-c4774b7af3d9 req-83a2f71e-f232-4eb2-97cd-f2eb4dd80d43 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:16:06 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-f4560bf9-cddb-4b59-a71e-c4774b7af3d9 req-83a2f71e-f232-4eb2-97cd-f2eb4dd80d43 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:16:06 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-f4560bf9-cddb-4b59-a71e-c4774b7af3d9 req-83a2f71e-f232-4eb2-97cd-f2eb4dd80d43 service nova] Creating event network-vif-plugged:8c280312-1554-4ee3-aadd-aa4929fecbda for instance 027f1645-6991-4726-b1f4-2728db710061 on user Apr 17 11:16:06 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-f4560bf9-cddb-4b59-a71e-c4774b7af3d9 req-83a2f71e-f232-4eb2-97cd-f2eb4dd80d43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031059 Apr 17 11:16:06 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 358/1107] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:16:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:16:41 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=4 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:16:41 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=8 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:16:41 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-d2f53eea-ca9f-47db-827d-a1e8a76d262e tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:16:41 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-d2f53eea-ca9f-47db-827d-a1e8a76d262e tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] [instance: 3fed4f97-8392-4f60-a0b5-c74f5100dbc4] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:16:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d2f53eea-ca9f-47db-827d-a1e8a76d262e tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:16:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d2f53eea-ca9f-47db-827d-a1e8a76d262e tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:16:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d2f53eea-ca9f-47db-827d-a1e8a76d262e tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:16:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d2f53eea-ca9f-47db-827d-a1e8a76d262e tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:16:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d2f53eea-ca9f-47db-827d-a1e8a76d262e tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:16:41 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-d2f53eea-ca9f-47db-827d-a1e8a76d262e tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:16:41 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-d2f53eea-ca9f-47db-827d-a1e8a76d262e tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] HTTP exception thrown: Instance 3fed4f97-8392-4f60-a0b5-c74f5100dbc4 could not be found. Apr 17 11:16:41 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-d2f53eea-ca9f-47db-827d-a1e8a76d262e tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Request method failure captured: Apr 17 11:16:41 user devstack@n-api.service[72745]: request: GET /compute/v2.1/servers/3fed4f97-8392-4f60-a0b5-c74f5100dbc4 HTTP/1.1 Apr 17 11:16:41 user devstack@n-api.service[72745]: Accept: application/json Apr 17 11:16:41 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 11:16:41 user devstack@n-api.service[72745]: Connection: close Apr 17 11:16:41 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 11:16:41 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 11:16:41 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 11:16:41 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 11:16:41 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 11:16:41 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSnvoP8pqIoh_NaJG7QeAdt_e_tojg1eW1iJUex2omUz7joHDRv0ygM-yDr1sOBojh2s4MgxkYEwfPzjw68ZVqYJ0AA81b-GQaD6sNEBqJKZnrEswTDAQWXvZxIljnwVXGNmI-tCmVmQYvciHJbT_3LSuSIQPvDLLTEkhxhne6Vkyhc Apr 17 11:16:41 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 11:16:41 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 11:16:41 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 11:16:41 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 11:16:41 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 11:16:41 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 11:16:41 user devstack@n-api.service[72745]: X-Project-Id: 44a166c75d3243199b27bfc1fe838615 Apr 17 11:16:41 user devstack@n-api.service[72745]: X-Project-Name: tempest-VolumesActionsTest-581321534 Apr 17 11:16:41 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 11:16:41 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 11:16:41 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44a166c75d3243199b27bfc1fe838615"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44a166c75d3243199b27bfc1fe838615"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/44a166c75d3243199b27bfc1fe838615"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:16:41 user devstack@n-api.service[72745]: X-Tenant: tempest-VolumesActionsTest-581321534 Apr 17 11:16:41 user devstack@n-api.service[72745]: X-Tenant-Id: 44a166c75d3243199b27bfc1fe838615 Apr 17 11:16:41 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-VolumesActionsTest-581321534 Apr 17 11:16:41 user devstack@n-api.service[72745]: X-User: tempest-VolumesActionsTest-581321534-project-member Apr 17 11:16:41 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 11:16:41 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 11:16:41 user devstack@n-api.service[72745]: X-User-Id: c994df66781047cd9fd114711b94606e Apr 17 11:16:41 user devstack@n-api.service[72745]: X-User-Name: tempest-VolumesActionsTest-581321534-project-member Apr 17 11:16:41 user devstack@n-api.service[72745]: method: > Apr 17 11:16:41 user devstack@n-api.service[72745]: exception: Instance 3fed4f97-8392-4f60-a0b5-c74f5100dbc4 could not be found. Apr 17 11:16:41 user devstack@n-api.service[72745]: action_args: {'id': '3fed4f97-8392-4f60-a0b5-c74f5100dbc4'} Apr 17 11:16:41 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fed4f97-8392-4f60-a0b5-c74f5100dbc4 could not be found. Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fed4f97-8392-4f60-a0b5-c74f5100dbc4 could not be found. Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fed4f97-8392-4f60-a0b5-c74f5100dbc4 could not be found. Apr 17 11:16:41 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:16:41 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-d2f53eea-ca9f-47db-827d-a1e8a76d262e tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] Returning 404 to user: Instance 3fed4f97-8392-4f60-a0b5-c74f5100dbc4 could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:16:41 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-d2f53eea-ca9f-47db-827d-a1e8a76d262e tempest-VolumesActionsTest-581321534 tempest-VolumesActionsTest-581321534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3fed4f97-8392-4f60-a0b5-c74f5100dbc4" status: 404 len: 111 microversion: 2.1 time: 0.044556 Apr 17 11:16:41 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 379/1108] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:16:41 2023] GET /compute/v2.1/servers/3fed4f97-8392-4f60-a0b5-c74f5100dbc4 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 11:16:53 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:16:53 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:16:53 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b5a9acfb-eba5-48cf-af9b-7667cfad6aa0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:16:53 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-b5a9acfb-eba5-48cf-af9b-7667cfad6aa0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:16:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b5a9acfb-eba5-48cf-af9b-7667cfad6aa0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:16:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b5a9acfb-eba5-48cf-af9b-7667cfad6aa0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:16:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b5a9acfb-eba5-48cf-af9b-7667cfad6aa0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:16:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b5a9acfb-eba5-48cf-af9b-7667cfad6aa0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:16:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b5a9acfb-eba5-48cf-af9b-7667cfad6aa0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:16:53 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b5a9acfb-eba5-48cf-af9b-7667cfad6aa0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:16:53 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-b5a9acfb-eba5-48cf-af9b-7667cfad6aa0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] HTTP exception thrown: Instance 027f1645-6991-4726-b1f4-2728db710061 could not be found. Apr 17 11:16:53 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b5a9acfb-eba5-48cf-af9b-7667cfad6aa0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Request method failure captured: Apr 17 11:16:53 user devstack@n-api.service[72743]: request: GET /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061 HTTP/1.1 Apr 17 11:16:53 user devstack@n-api.service[72743]: Accept: application/json Apr 17 11:16:53 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 11:16:53 user devstack@n-api.service[72743]: Connection: close Apr 17 11:16:53 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 11:16:53 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 11:16:53 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 11:16:53 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 11:16:53 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 11:16:53 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSkdNQlCQC0j_Scqt663u25JTKQ0VvHFR-Bs1WS4w1fclhhIe3uhdCjhS0GOk8WnVkAutnR7qqfJWjiB6gcAQZ5DHL7aRU3t4toaBkIvfpzRhhQyd8nAqMW--pdlYU2PLeANHC09fvmgTb5gEfrAhofFPyP8HzlyOsNLSJt_SNIjKTc Apr 17 11:16:53 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 11:16:53 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 11:16:53 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 11:16:53 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 11:16:53 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 11:16:53 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 11:16:53 user devstack@n-api.service[72743]: X-Project-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:16:53 user devstack@n-api.service[72743]: X-Project-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:16:53 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 11:16:53 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 11:16:53 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:16:53 user devstack@n-api.service[72743]: X-Tenant: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:16:53 user devstack@n-api.service[72743]: X-Tenant-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:16:53 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:16:53 user devstack@n-api.service[72743]: X-User: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:16:53 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 11:16:53 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 11:16:53 user devstack@n-api.service[72743]: X-User-Id: 8fc272a75798487d84beedfa65775423 Apr 17 11:16:53 user devstack@n-api.service[72743]: X-User-Name: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:16:53 user devstack@n-api.service[72743]: method: > Apr 17 11:16:53 user devstack@n-api.service[72743]: exception: Instance 027f1645-6991-4726-b1f4-2728db710061 could not be found. Apr 17 11:16:53 user devstack@n-api.service[72743]: action_args: {'id': '027f1645-6991-4726-b1f4-2728db710061'} Apr 17 11:16:53 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 027f1645-6991-4726-b1f4-2728db710061 could not be found. Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 027f1645-6991-4726-b1f4-2728db710061 could not be found. Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 027f1645-6991-4726-b1f4-2728db710061 could not be found. Apr 17 11:16:53 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:16:53 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b5a9acfb-eba5-48cf-af9b-7667cfad6aa0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Returning 404 to user: Instance 027f1645-6991-4726-b1f4-2728db710061 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:16:53 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-b5a9acfb-eba5-48cf-af9b-7667cfad6aa0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061" status: 404 len: 111 microversion: 2.1 time: 0.038680 Apr 17 11:16:53 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 372/1109] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:16:53 2023] GET /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 11:16:53 user devstack@n-api.service[72744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 17 11:16:53 user devstack@n-api.service[72744]: Mon Apr 17 11:16:53 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1469598392 (ip 10.0.0.210) !!! Apr 17 11:16:53 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:16:53 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:16:53 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-9d7e2964-3a28-486f-b8b4-f8dabb60a041 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '.version_select at 0x7fc55aaa2ef0>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:16:53 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-9d7e2964-3a28-486f-b8b4-f8dabb60a041 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1469598392" status: 202 len: 0 microversion: 2.1 time: 0.033390 Apr 17 11:16:53 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 359/1110] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Apr 17 11:16:53 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1469598392 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 11:16:54 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-5a4be23e-4469-45ec-b352-83599bb8a69b tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Action: 'create', calling method: .version_select at 0x7fc55a9ce8c0>, body: {"keypair": {"name": "tempest-keypair-1991316860", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ4Ype3k6uIacOsZ33NhrfeIFHdyZIcZRaN0TXlDymXjIc8Dyf+mNPp09SUT3LS5aaOANPy6I0+2lJinYLQeC+jLmCKVpbkSlM1FGVIZC4ogZOM96rNuSPFeoOJZWp3Ug=="}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:16:54 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:16:54 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:16:54 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-5a4be23e-4469-45ec-b352-83599bb8a69b tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Getting quotas for project 64eccc3b86914e4ab735b79c4b53a142. Resources: {'key_pairs'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 11:16:54 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-5a4be23e-4469-45ec-b352-83599bb8a69b tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Getting quotas for user 8fc272a75798487d84beedfa65775423 and project 64eccc3b86914e4ab735b79c4b53a142. Resources: {'key_pairs'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 11:16:54 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-5a4be23e-4469-45ec-b352-83599bb8a69b tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060830 Apr 17 11:16:54 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 380/1111] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 11:16:54 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:16:55 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-637753123", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce"}], "security_groups": [{"name": "tempest-securitygroup--1380059624"}], "key_name": "tempest-keypair-1991316860", "user_data": "}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:16:56 user devstack@n-api.service[72743]: DEBUG nova.network.neutron [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] validate_networks() for [('7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce', None, None, None, None, None)] {{(pid=72743) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 11:16:56 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Flavor limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 11:16:56 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Image limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 11:16:56 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Flavor pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 11:16:56 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Image pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 11:16:56 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 11:16:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:16:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:16:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:16:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:16:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:16:56 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:16:56 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Getting quotas for project 64eccc3b86914e4ab735b79c4b53a142. Resources: {'cores', 'instances', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 11:16:56 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Getting quotas for user 8fc272a75798487d84beedfa65775423 and project 64eccc3b86914e4ab735b79c4b53a142. Resources: {'cores', 'instances', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 11:16:56 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Going to run 1 instances... {{(pid=72743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 11:16:56 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 11:16:56 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-80600ecd-7d03-4fc0-bc57-f851f580b636 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.043201 Apr 17 11:16:56 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 373/1112] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 11:16:55 2023] POST /compute/v2.1/servers => generated 400 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 11:16:57 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-f8534492-02b2-4329-a642-2b901ad5db75 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:16:57 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-f8534492-02b2-4329-a642-2b901ad5db75 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:16:57 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-f8534492-02b2-4329-a642-2b901ad5db75 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc272a75798487d84beedfa65775423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eccc3b86914e4ab735b79c4b53a142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:16:57 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-f8534492-02b2-4329-a642-2b901ad5db75 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a" status: 200 len: 1235 microversion: 2.1 time: 0.122725 Apr 17 11:16:57 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 360/1113] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:16:56 2023] GET /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a => generated 1235 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:16:59 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-976a5972-7548-4b8c-803b-68485fe3b372 req-d9af7204-628e-4b26-b976-eb7348f535ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4368205b-a69c-49cd-958f-8f193856466a", "tag": "0b6550cf-9e2a-4181-90de-34925655d07c"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:16:59 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-976a5972-7548-4b8c-803b-68485fe3b372 req-d9af7204-628e-4b26-b976-eb7348f535ee service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:16:59 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-976a5972-7548-4b8c-803b-68485fe3b372 req-d9af7204-628e-4b26-b976-eb7348f535ee service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:16:59 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-976a5972-7548-4b8c-803b-68485fe3b372 req-d9af7204-628e-4b26-b976-eb7348f535ee service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:16:59 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-976a5972-7548-4b8c-803b-68485fe3b372 req-d9af7204-628e-4b26-b976-eb7348f535ee service nova] Creating event network-changed:0b6550cf-9e2a-4181-90de-34925655d07c for instance 4368205b-a69c-49cd-958f-8f193856466a on user Apr 17 11:16:59 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-976a5972-7548-4b8c-803b-68485fe3b372 req-d9af7204-628e-4b26-b976-eb7348f535ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030148 Apr 17 11:16:59 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 381/1114] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:16:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:17:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-d87bed79-27c0-4092-9617-413274b9b3da req-028472fa-ead9-4ae0-bfd8-92988e25a6fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4368205b-a69c-49cd-958f-8f193856466a", "name": "network-vif-plugged", "status": "completed", "tag": "0b6550cf-9e2a-4181-90de-34925655d07c"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:17:01 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-d87bed79-27c0-4092-9617-413274b9b3da req-028472fa-ead9-4ae0-bfd8-92988e25a6fe service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:17:01 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-d87bed79-27c0-4092-9617-413274b9b3da req-028472fa-ead9-4ae0-bfd8-92988e25a6fe service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:17:01 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-d87bed79-27c0-4092-9617-413274b9b3da req-028472fa-ead9-4ae0-bfd8-92988e25a6fe service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:17:01 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-d87bed79-27c0-4092-9617-413274b9b3da req-028472fa-ead9-4ae0-bfd8-92988e25a6fe service nova] Creating event network-vif-plugged:0b6550cf-9e2a-4181-90de-34925655d07c for instance 4368205b-a69c-49cd-958f-8f193856466a on user Apr 17 11:17:01 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-d87bed79-27c0-4092-9617-413274b9b3da req-028472fa-ead9-4ae0-bfd8-92988e25a6fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052100 Apr 17 11:17:01 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 374/1115] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:17:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:17:03 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-d665ddd5-1b80-4dc9-adcf-16d62489348e req-8583d355-26ea-45dd-b4b5-1bcb862ae3f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4368205b-a69c-49cd-958f-8f193856466a", "name": "network-vif-plugged", "status": "completed", "tag": "0b6550cf-9e2a-4181-90de-34925655d07c"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:17:03 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-d665ddd5-1b80-4dc9-adcf-16d62489348e req-8583d355-26ea-45dd-b4b5-1bcb862ae3f1 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:17:03 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-d665ddd5-1b80-4dc9-adcf-16d62489348e req-8583d355-26ea-45dd-b4b5-1bcb862ae3f1 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:17:03 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-d665ddd5-1b80-4dc9-adcf-16d62489348e req-8583d355-26ea-45dd-b4b5-1bcb862ae3f1 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:17:03 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-d665ddd5-1b80-4dc9-adcf-16d62489348e req-8583d355-26ea-45dd-b4b5-1bcb862ae3f1 service nova] Creating event network-vif-plugged:0b6550cf-9e2a-4181-90de-34925655d07c for instance 4368205b-a69c-49cd-958f-8f193856466a on user Apr 17 11:17:03 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-d665ddd5-1b80-4dc9-adcf-16d62489348e req-8583d355-26ea-45dd-b4b5-1bcb862ae3f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035187 Apr 17 11:17:03 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 361/1116] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:17:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:17:47 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=4 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:17:47 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:17:47 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:17:47 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-5afea862-a690-44d6-849e-e6ce04adf1be tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:17:47 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-5afea862-a690-44d6-849e-e6ce04adf1be tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:17:47 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5afea862-a690-44d6-849e-e6ce04adf1be tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:17:47 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5afea862-a690-44d6-849e-e6ce04adf1be tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:17:47 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5afea862-a690-44d6-849e-e6ce04adf1be tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:17:47 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5afea862-a690-44d6-849e-e6ce04adf1be tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:17:47 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5afea862-a690-44d6-849e-e6ce04adf1be tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:17:47 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-5afea862-a690-44d6-849e-e6ce04adf1be tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:17:47 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-5afea862-a690-44d6-849e-e6ce04adf1be tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc272a75798487d84beedfa65775423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eccc3b86914e4ab735b79c4b53a142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:17:47 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-5afea862-a690-44d6-849e-e6ce04adf1be tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a" status: 200 len: 1545 microversion: 2.1 time: 0.534432 Apr 17 11:17:47 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 382/1117] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:17:47 2023] GET /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a => generated 1545 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:18:11 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:18:11 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:18:11 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:18:11 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:18:11 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1703499174", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42"}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:18:11 user devstack@n-api.service[72743]: DEBUG nova.network.neutron [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] validate_networks() for None {{(pid=72743) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 11:18:11 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Flavor limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 11:18:11 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Image limits 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 11:18:11 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Flavor pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 11:18:11 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Image pref 0:0:0 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 11:18:11 user devstack@n-api.service[72743]: DEBUG nova.virt.hardware [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 11:18:11 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:18:11 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:18:11 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:18:11 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:18:11 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:18:11 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:18:11 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Getting quotas for project 8b8e27f859154b75814c80a52166ba1e. Resources: {'cores', 'instances', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 11:18:11 user devstack@n-api.service[72743]: DEBUG nova.quota [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Getting quotas for user 819b4316675948e7b0bc8d05d47b57a3 and project 8b8e27f859154b75814c80a52166ba1e. Resources: {'cores', 'instances', 'ram'} {{(pid=72743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 11:18:11 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Going to run 1 instances... {{(pid=72743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 11:18:11 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 11:18:11 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-e4108ec9-1b83-47c1-8712-0783afddf8d6 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.420719 Apr 17 11:18:11 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 375/1118] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 11:18:11 2023] POST /compute/v2.1/servers => generated 378 bytes in 422 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 11:18:11 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:18:11 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:18:11 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:18:11 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-a49a0acf-16e0-4154-927d-b652a1f4a678 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:18:11 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-a49a0acf-16e0-4154-927d-b652a1f4a678 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:18:11 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-a49a0acf-16e0-4154-927d-b652a1f4a678 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819b4316675948e7b0bc8d05d47b57a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8e27f859154b75814c80a52166ba1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:18:11 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-a49a0acf-16e0-4154-927d-b652a1f4a678 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7931d89-3448-4dab-92aa-9804d72363ce" status: 200 len: 1209 microversion: 2.1 time: 0.069858 Apr 17 11:18:11 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 362/1119] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:18:11 2023] GET /compute/v2.1/servers/d7931d89-3448-4dab-92aa-9804d72363ce => generated 1209 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:18:14 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:18:14 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:18:14 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-484b6554-457a-4570-9211-db1f1795ed80 req-fa6dc06d-07c2-403a-b17a-b7f28c9ad2ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7931d89-3448-4dab-92aa-9804d72363ce", "tag": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:18:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-484b6554-457a-4570-9211-db1f1795ed80 req-fa6dc06d-07c2-403a-b17a-b7f28c9ad2ae service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:18:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-484b6554-457a-4570-9211-db1f1795ed80 req-fa6dc06d-07c2-403a-b17a-b7f28c9ad2ae service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:18:14 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-484b6554-457a-4570-9211-db1f1795ed80 req-fa6dc06d-07c2-403a-b17a-b7f28c9ad2ae service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:18:14 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-484b6554-457a-4570-9211-db1f1795ed80 req-fa6dc06d-07c2-403a-b17a-b7f28c9ad2ae service nova] Creating event network-changed:7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77 for instance d7931d89-3448-4dab-92aa-9804d72363ce on user Apr 17 11:18:14 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-484b6554-457a-4570-9211-db1f1795ed80 req-fa6dc06d-07c2-403a-b17a-b7f28c9ad2ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093367 Apr 17 11:18:14 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 383/1120] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:18:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:18:16 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-d8e706c1-edf8-429f-92b3-2749f2bf5bd3 req-8e42d100-7318-4113-b726-33a9737aa7c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7931d89-3448-4dab-92aa-9804d72363ce", "name": "network-vif-plugged", "status": "completed", "tag": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:18:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-d8e706c1-edf8-429f-92b3-2749f2bf5bd3 req-8e42d100-7318-4113-b726-33a9737aa7c6 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:18:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-d8e706c1-edf8-429f-92b3-2749f2bf5bd3 req-8e42d100-7318-4113-b726-33a9737aa7c6 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:18:16 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-d8e706c1-edf8-429f-92b3-2749f2bf5bd3 req-8e42d100-7318-4113-b726-33a9737aa7c6 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:18:16 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-d8e706c1-edf8-429f-92b3-2749f2bf5bd3 req-8e42d100-7318-4113-b726-33a9737aa7c6 service nova] Creating event network-vif-plugged:7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77 for instance d7931d89-3448-4dab-92aa-9804d72363ce on user Apr 17 11:18:16 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-d8e706c1-edf8-429f-92b3-2749f2bf5bd3 req-8e42d100-7318-4113-b726-33a9737aa7c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031698 Apr 17 11:18:16 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 376/1121] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:18:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:18:18 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-2906b051-c9b6-4cb4-a8f6-576a8fd437fb req-ff06efff-e4e1-4393-8233-bf65589fff38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7931d89-3448-4dab-92aa-9804d72363ce", "name": "network-vif-plugged", "status": "completed", "tag": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:18:18 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-2906b051-c9b6-4cb4-a8f6-576a8fd437fb req-ff06efff-e4e1-4393-8233-bf65589fff38 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:18:18 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-2906b051-c9b6-4cb4-a8f6-576a8fd437fb req-ff06efff-e4e1-4393-8233-bf65589fff38 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:18:18 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-2906b051-c9b6-4cb4-a8f6-576a8fd437fb req-ff06efff-e4e1-4393-8233-bf65589fff38 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:18:18 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-2906b051-c9b6-4cb4-a8f6-576a8fd437fb req-ff06efff-e4e1-4393-8233-bf65589fff38 service nova] Creating event network-vif-plugged:7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77 for instance d7931d89-3448-4dab-92aa-9804d72363ce on user Apr 17 11:18:18 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-2906b051-c9b6-4cb4-a8f6-576a8fd437fb req-ff06efff-e4e1-4393-8233-bf65589fff38 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029757 Apr 17 11:18:18 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 363/1122] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:18:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:18:47 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-7d72d2c8-319c-401b-b94c-c80f3cbfc5e5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:18:47 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-7d72d2c8-319c-401b-b94c-c80f3cbfc5e5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:18:47 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:18:47 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:18:47 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7d72d2c8-319c-401b-b94c-c80f3cbfc5e5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:18:47 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7d72d2c8-319c-401b-b94c-c80f3cbfc5e5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:18:47 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7d72d2c8-319c-401b-b94c-c80f3cbfc5e5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:18:47 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7d72d2c8-319c-401b-b94c-c80f3cbfc5e5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:18:47 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7d72d2c8-319c-401b-b94c-c80f3cbfc5e5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:18:47 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-7d72d2c8-319c-401b-b94c-c80f3cbfc5e5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:18:47 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-7d72d2c8-319c-401b-b94c-c80f3cbfc5e5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.227751 Apr 17 11:18:47 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 384/1123] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 17 11:18:47 2023] GET /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a/os-interface => generated 283 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:18:48 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:18:48 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:18:48 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:18:48 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=4 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:18:48 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-16b265dc-1cb5-4367-a90a-1b20d22a8db4 req-23794386-5766-4254-b9e0-aa1db401a657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4368205b-a69c-49cd-958f-8f193856466a", "tag": "0b6550cf-9e2a-4181-90de-34925655d07c"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:18:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-16b265dc-1cb5-4367-a90a-1b20d22a8db4 req-23794386-5766-4254-b9e0-aa1db401a657 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:18:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-16b265dc-1cb5-4367-a90a-1b20d22a8db4 req-23794386-5766-4254-b9e0-aa1db401a657 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:18:48 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-16b265dc-1cb5-4367-a90a-1b20d22a8db4 req-23794386-5766-4254-b9e0-aa1db401a657 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:18:48 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-16b265dc-1cb5-4367-a90a-1b20d22a8db4 req-23794386-5766-4254-b9e0-aa1db401a657 service nova] Creating event network-changed:0b6550cf-9e2a-4181-90de-34925655d07c for instance 4368205b-a69c-49cd-958f-8f193856466a on user Apr 17 11:18:48 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-16b265dc-1cb5-4367-a90a-1b20d22a8db4 req-23794386-5766-4254-b9e0-aa1db401a657 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042618 Apr 17 11:18:48 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 377/1124] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:18:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:18:49 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-d2d109e2-b11e-401c-9aa8-539cac7a2562 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:18:49 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-d2d109e2-b11e-401c-9aa8-539cac7a2562 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:18:49 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:18:49 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:18:49 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:18:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d2d109e2-b11e-401c-9aa8-539cac7a2562 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:18:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d2d109e2-b11e-401c-9aa8-539cac7a2562 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:18:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d2d109e2-b11e-401c-9aa8-539cac7a2562 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:18:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d2d109e2-b11e-401c-9aa8-539cac7a2562 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:18:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d2d109e2-b11e-401c-9aa8-539cac7a2562 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:18:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d2d109e2-b11e-401c-9aa8-539cac7a2562 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:18:50 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-d2d109e2-b11e-401c-9aa8-539cac7a2562 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a/ips" status: 200 len: 108 microversion: 2.1 time: 0.083612 Apr 17 11:18:50 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 364/1125] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 17 11:18:49 2023] GET /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a/ips => generated 108 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:18:52 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "528310c6-770e-4d69-97cb-0ef4a7484760"}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:18:52 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:18:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:18:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:18:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:18:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:18:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:18:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:18:52 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-77b59590-26e9-43c0-bd7c-61be2b0947cd tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333086 Apr 17 11:18:52 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 385/1126] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Apr 17 11:18:52 2023] POST /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:19:00 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:19:00 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:19:00 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-38e6beb0-9f25-43cf-b414-9dc74dbe0bf8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "528310c6-770e-4d69-97cb-0ef4a7484760"}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:19:00 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-38e6beb0-9f25-43cf-b414-9dc74dbe0bf8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:19:00 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-38e6beb0-9f25-43cf-b414-9dc74dbe0bf8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:19:00 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-38e6beb0-9f25-43cf-b414-9dc74dbe0bf8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:19:00 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-38e6beb0-9f25-43cf-b414-9dc74dbe0bf8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:19:00 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-38e6beb0-9f25-43cf-b414-9dc74dbe0bf8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:19:00 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-38e6beb0-9f25-43cf-b414-9dc74dbe0bf8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:19:00 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-38e6beb0-9f25-43cf-b414-9dc74dbe0bf8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:19:00 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-38e6beb0-9f25-43cf-b414-9dc74dbe0bf8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] HTTP exception thrown: Invalid volume: volume 528310c6-770e-4d69-97cb-0ef4a7484760 is already attached to instances: 4368205b-a69c-49cd-958f-8f193856466a Apr 17 11:19:00 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-38e6beb0-9f25-43cf-b414-9dc74dbe0bf8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Request method failure captured: Apr 17 11:19:00 user devstack@n-api.service[72743]: request: POST /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a/os-volume_attachments HTTP/1.1 Apr 17 11:19:00 user devstack@n-api.service[72743]: Accept: application/json Apr 17 11:19:00 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 11:19:00 user devstack@n-api.service[72743]: Connection: close Apr 17 11:19:00 user devstack@n-api.service[72743]: Content-Length: 74 Apr 17 11:19:00 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 11:19:00 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 11:19:00 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 11:19:00 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 11:19:00 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSkdNQlCQC0j_Scqt663u25JTKQ0VvHFR-Bs1WS4w1fclhhIe3uhdCjhS0GOk8WnVkAutnR7qqfJWjiB6gcAQZ5DHL7aRU3t4toaBkIvfpzRhhQyd8nAqMW--pdlYU2PLeANHC09fvmgTb5gEfrAhofFPyP8HzlyOsNLSJt_SNIjKTc Apr 17 11:19:00 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 11:19:00 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 11:19:00 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 11:19:00 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 11:19:00 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 11:19:00 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 11:19:00 user devstack@n-api.service[72743]: X-Project-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:19:00 user devstack@n-api.service[72743]: X-Project-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:19:00 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 11:19:00 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 11:19:00 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:19:00 user devstack@n-api.service[72743]: X-Tenant: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:19:00 user devstack@n-api.service[72743]: X-Tenant-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:19:00 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:19:00 user devstack@n-api.service[72743]: X-User: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:19:00 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 11:19:00 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 11:19:00 user devstack@n-api.service[72743]: X-User-Id: 8fc272a75798487d84beedfa65775423 Apr 17 11:19:00 user devstack@n-api.service[72743]: X-User-Name: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:19:00 user devstack@n-api.service[72743]: Apr 17 11:19:00 user devstack@n-api.service[72743]: {"volumeAttachment": {"volumeId": "528310c6-770e-4d69-97cb-0ef4a7484760"}} Apr 17 11:19:00 user devstack@n-api.service[72743]: method: > Apr 17 11:19:00 user devstack@n-api.service[72743]: exception: Invalid volume: volume 528310c6-770e-4d69-97cb-0ef4a7484760 is already attached to instances: 4368205b-a69c-49cd-958f-8f193856466a Apr 17 11:19:00 user devstack@n-api.service[72743]: action_args: {'server_id': '4368205b-a69c-49cd-958f-8f193856466a', 'body': {'volumeAttachment': {'volumeId': '528310c6-770e-4d69-97cb-0ef4a7484760'}}} Apr 17 11:19:00 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 528310c6-770e-4d69-97cb-0ef4a7484760 is already attached to instances: 4368205b-a69c-49cd-958f-8f193856466a Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 528310c6-770e-4d69-97cb-0ef4a7484760 is already attached to instances: 4368205b-a69c-49cd-958f-8f193856466a Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 528310c6-770e-4d69-97cb-0ef4a7484760 is already attached to instances: 4368205b-a69c-49cd-958f-8f193856466a Apr 17 11:19:00 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:19:00 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-38e6beb0-9f25-43cf-b414-9dc74dbe0bf8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Returning 400 to user: Invalid volume: volume 528310c6-770e-4d69-97cb-0ef4a7484760 is already attached to instances: 4368205b-a69c-49cd-958f-8f193856466a {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:19:00 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-38e6beb0-9f25-43cf-b414-9dc74dbe0bf8 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098135 Apr 17 11:19:00 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 378/1127] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Apr 17 11:19:00 2023] POST /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 17 11:19:00 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:19:00 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:19:00 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:19:00 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=4 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:19:00 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:19:00 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:19:00 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:19:00 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:19:00 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:19:00 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:19:00 user devstack@n-api.service[72744]: DEBUG nova.objects.instance [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lazy-loading 'services' on Instance uuid 4368205b-a69c-49cd-958f-8f193856466a {{(pid=72744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 11:19:00 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-a13c2a19-152e-4c64-b9a4-c4dd20f03b80 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a/os-volume_attachments/528310c6-770e-4d69-97cb-0ef4a7484760" status: 202 len: 0 microversion: 2.1 time: 0.181569 Apr 17 11:19:00 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 365/1128] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Apr 17 11:19:00 2023] DELETE /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a/os-volume_attachments/528310c6-770e-4d69-97cb-0ef4a7484760 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 11:19:00 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-db055f8b-cd5e-4ef1-9eb2-ad460fbc7e71 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:19:00 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-db055f8b-cd5e-4ef1-9eb2-ad460fbc7e71 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:19:00 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-db055f8b-cd5e-4ef1-9eb2-ad460fbc7e71 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:19:00 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-db055f8b-cd5e-4ef1-9eb2-ad460fbc7e71 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:19:00 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-db055f8b-cd5e-4ef1-9eb2-ad460fbc7e71 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:19:00 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-db055f8b-cd5e-4ef1-9eb2-ad460fbc7e71 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:19:00 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-db055f8b-cd5e-4ef1-9eb2-ad460fbc7e71 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:19:00 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-db055f8b-cd5e-4ef1-9eb2-ad460fbc7e71 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:19:00 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-db055f8b-cd5e-4ef1-9eb2-ad460fbc7e71 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047394 Apr 17 11:19:00 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 386/1129] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 11:19:00 2023] GET /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:19:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-eb9f1769-331d-4a07-9c6f-d50c8560f5a9 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:19:01 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-eb9f1769-331d-4a07-9c6f-d50c8560f5a9 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:19:01 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-eb9f1769-331d-4a07-9c6f-d50c8560f5a9 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:19:01 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-eb9f1769-331d-4a07-9c6f-d50c8560f5a9 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:19:01 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-eb9f1769-331d-4a07-9c6f-d50c8560f5a9 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:19:01 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-eb9f1769-331d-4a07-9c6f-d50c8560f5a9 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:19:01 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-eb9f1769-331d-4a07-9c6f-d50c8560f5a9 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:19:01 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-eb9f1769-331d-4a07-9c6f-d50c8560f5a9 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:19:01 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-eb9f1769-331d-4a07-9c6f-d50c8560f5a9 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819b4316675948e7b0bc8d05d47b57a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8e27f859154b75814c80a52166ba1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:19:01 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-eb9f1769-331d-4a07-9c6f-d50c8560f5a9 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7931d89-3448-4dab-92aa-9804d72363ce" status: 200 len: 1455 microversion: 2.1 time: 0.219280 Apr 17 11:19:01 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 379/1130] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:19:01 2023] GET /compute/v2.1/servers/d7931d89-3448-4dab-92aa-9804d72363ce => generated 1455 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:19:50 user devstack@n-api.service[72744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 17 11:19:50 user devstack@n-api.service[72744]: Mon Apr 17 11:19:50 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a/os-volume_attachments (ip 10.0.0.210) !!! Apr 17 11:19:50 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:19:50 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:19:50 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-dbd43154-02c2-47db-ad25-43d18307fc7b tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:19:50 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-dbd43154-02c2-47db-ad25-43d18307fc7b tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:19:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dbd43154-02c2-47db-ad25-43d18307fc7b tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:19:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dbd43154-02c2-47db-ad25-43d18307fc7b tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:19:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dbd43154-02c2-47db-ad25-43d18307fc7b tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:19:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dbd43154-02c2-47db-ad25-43d18307fc7b tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:19:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dbd43154-02c2-47db-ad25-43d18307fc7b tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:19:50 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-dbd43154-02c2-47db-ad25-43d18307fc7b tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:19:50 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-dbd43154-02c2-47db-ad25-43d18307fc7b tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058011 Apr 17 11:19:50 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 366/1131] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 11:19:50 2023] GET /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 17 11:19:50 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:19:50 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:19:50 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=6 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:19:50 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:19:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:19:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:19:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:19:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:19:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:19:50 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:19:50 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Going to try to terminate instance {{(pid=72745) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 11:19:51 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-2710ecb1-0e06-4b76-a51a-f19eb6b43753 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a" status: 204 len: 0 microversion: 2.1 time: 0.139166 Apr 17 11:19:51 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 387/1132] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 11:19:50 2023] DELETE /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 11:19:51 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-e1fe555d-47c8-4391-b253-5ed43247c628 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:19:51 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-e1fe555d-47c8-4391-b253-5ed43247c628 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:19:51 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=4 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:19:51 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=12 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:19:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e1fe555d-47c8-4391-b253-5ed43247c628 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:19:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e1fe555d-47c8-4391-b253-5ed43247c628 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:19:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e1fe555d-47c8-4391-b253-5ed43247c628 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:19:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e1fe555d-47c8-4391-b253-5ed43247c628 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:19:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e1fe555d-47c8-4391-b253-5ed43247c628 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:19:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-e1fe555d-47c8-4391-b253-5ed43247c628 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:19:51 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-b914ac5c-bfa1-40f5-8147-0967423ad443 req-632b81ba-e983-4897-9d6f-f47dd61955fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4368205b-a69c-49cd-958f-8f193856466a", "name": "network-vif-unplugged", "status": "completed", "tag": "0b6550cf-9e2a-4181-90de-34925655d07c"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:19:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-b914ac5c-bfa1-40f5-8147-0967423ad443 req-632b81ba-e983-4897-9d6f-f47dd61955fb service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:19:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-b914ac5c-bfa1-40f5-8147-0967423ad443 req-632b81ba-e983-4897-9d6f-f47dd61955fb service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:19:51 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-b914ac5c-bfa1-40f5-8147-0967423ad443 req-632b81ba-e983-4897-9d6f-f47dd61955fb service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:19:51 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-b914ac5c-bfa1-40f5-8147-0967423ad443 req-632b81ba-e983-4897-9d6f-f47dd61955fb service nova] Creating event network-vif-unplugged:0b6550cf-9e2a-4181-90de-34925655d07c for instance 4368205b-a69c-49cd-958f-8f193856466a on user Apr 17 11:19:51 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-b914ac5c-bfa1-40f5-8147-0967423ad443 req-632b81ba-e983-4897-9d6f-f47dd61955fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104990 Apr 17 11:19:51 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 367/1133] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:19:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:19:51 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-e1fe555d-47c8-4391-b253-5ed43247c628 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc272a75798487d84beedfa65775423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eccc3b86914e4ab735b79c4b53a142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:19:51 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-e1fe555d-47c8-4391-b253-5ed43247c628 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a" status: 200 len: 1670 microversion: 2.1 time: 0.353412 Apr 17 11:19:51 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 380/1134] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:19:51 2023] GET /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a => generated 1670 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:19:52 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-d7a1c032-831f-4387-acf9-f4f21fcf532e req-fcc7ee40-9143-45d5-8c62-eb82602ac77b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4368205b-a69c-49cd-958f-8f193856466a", "name": "network-vif-deleted", "tag": "0b6550cf-9e2a-4181-90de-34925655d07c"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:19:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-d7a1c032-831f-4387-acf9-f4f21fcf532e req-fcc7ee40-9143-45d5-8c62-eb82602ac77b service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:19:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-d7a1c032-831f-4387-acf9-f4f21fcf532e req-fcc7ee40-9143-45d5-8c62-eb82602ac77b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:19:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-d7a1c032-831f-4387-acf9-f4f21fcf532e req-fcc7ee40-9143-45d5-8c62-eb82602ac77b service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:19:52 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-d7a1c032-831f-4387-acf9-f4f21fcf532e req-fcc7ee40-9143-45d5-8c62-eb82602ac77b service nova] Creating event network-vif-deleted:0b6550cf-9e2a-4181-90de-34925655d07c for instance 4368205b-a69c-49cd-958f-8f193856466a on user Apr 17 11:19:52 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-d7a1c032-831f-4387-acf9-f4f21fcf532e req-fcc7ee40-9143-45d5-8c62-eb82602ac77b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030573 Apr 17 11:19:52 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 388/1135] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:19:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:19:53 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-8b8bacd1-a4de-4c8d-ac58-e88e474503a0 req-18caefdc-88e6-4545-9b60-f0988072e47c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4368205b-a69c-49cd-958f-8f193856466a", "name": "network-vif-plugged", "status": "completed", "tag": "0b6550cf-9e2a-4181-90de-34925655d07c"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:19:53 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-8b8bacd1-a4de-4c8d-ac58-e88e474503a0 req-18caefdc-88e6-4545-9b60-f0988072e47c service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:19:53 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-8b8bacd1-a4de-4c8d-ac58-e88e474503a0 req-18caefdc-88e6-4545-9b60-f0988072e47c service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:19:53 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-8b8bacd1-a4de-4c8d-ac58-e88e474503a0 req-18caefdc-88e6-4545-9b60-f0988072e47c service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:19:53 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-8b8bacd1-a4de-4c8d-ac58-e88e474503a0 req-18caefdc-88e6-4545-9b60-f0988072e47c service nova] Creating event network-vif-plugged:0b6550cf-9e2a-4181-90de-34925655d07c for instance 4368205b-a69c-49cd-958f-8f193856466a on user Apr 17 11:19:53 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-8b8bacd1-a4de-4c8d-ac58-e88e474503a0 req-18caefdc-88e6-4545-9b60-f0988072e47c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033723 Apr 17 11:19:53 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 368/1136] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:19:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:20:01 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:20:01 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:20:02 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:20:02 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=6 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:20:02 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:20:02 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:20:02 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:20:02 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:20:02 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:20:02 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:20:02 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Going to try to terminate instance {{(pid=72743) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 11:20:02 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-f47b8bb4-e5f0-4afd-980a-525e2abd5e64 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d7931d89-3448-4dab-92aa-9804d72363ce" status: 204 len: 0 microversion: 2.1 time: 0.110199 Apr 17 11:20:02 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 381/1137] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 11:20:01 2023] DELETE /compute/v2.1/servers/d7931d89-3448-4dab-92aa-9804d72363ce => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 11:20:02 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-9dbf6bb5-fece-4df1-98c2-64fad163b784 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:20:02 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-9dbf6bb5-fece-4df1-98c2-64fad163b784 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:20:02 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9dbf6bb5-fece-4df1-98c2-64fad163b784 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:20:02 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9dbf6bb5-fece-4df1-98c2-64fad163b784 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:20:02 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9dbf6bb5-fece-4df1-98c2-64fad163b784 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:20:02 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9dbf6bb5-fece-4df1-98c2-64fad163b784 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:20:02 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9dbf6bb5-fece-4df1-98c2-64fad163b784 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:20:02 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9dbf6bb5-fece-4df1-98c2-64fad163b784 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:20:02 user devstack@n-api.service[72745]: DEBUG nova.policy [None req-9dbf6bb5-fece-4df1-98c2-64fad163b784 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819b4316675948e7b0bc8d05d47b57a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8e27f859154b75814c80a52166ba1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72745) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:20:02 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-9dbf6bb5-fece-4df1-98c2-64fad163b784 tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7931d89-3448-4dab-92aa-9804d72363ce" status: 200 len: 1461 microversion: 2.1 time: 0.253904 Apr 17 11:20:02 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 389/1138] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:20:02 2023] GET /compute/v2.1/servers/d7931d89-3448-4dab-92aa-9804d72363ce => generated 1461 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:20:02 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-ecd80d3b-09a4-4bac-9d53-6c316180f21b req-e8b009b8-ee87-443a-9c11-7622860280eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7931d89-3448-4dab-92aa-9804d72363ce", "name": "network-vif-unplugged", "status": "completed", "tag": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:20:02 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-ecd80d3b-09a4-4bac-9d53-6c316180f21b req-e8b009b8-ee87-443a-9c11-7622860280eb service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:20:02 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-ecd80d3b-09a4-4bac-9d53-6c316180f21b req-e8b009b8-ee87-443a-9c11-7622860280eb service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:20:02 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-ecd80d3b-09a4-4bac-9d53-6c316180f21b req-e8b009b8-ee87-443a-9c11-7622860280eb service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:20:02 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-ecd80d3b-09a4-4bac-9d53-6c316180f21b req-e8b009b8-ee87-443a-9c11-7622860280eb service nova] Creating event network-vif-unplugged:7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77 for instance d7931d89-3448-4dab-92aa-9804d72363ce on user Apr 17 11:20:02 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-ecd80d3b-09a4-4bac-9d53-6c316180f21b req-e8b009b8-ee87-443a-9c11-7622860280eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030912 Apr 17 11:20:02 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 369/1139] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:20:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:20:03 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-b062c955-0f3a-4de9-bbc8-50bae4be91e4 req-b1d7daa8-03d4-4585-91ec-6e52a04a538f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7931d89-3448-4dab-92aa-9804d72363ce", "name": "network-vif-deleted", "tag": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:20:03 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-b062c955-0f3a-4de9-bbc8-50bae4be91e4 req-b1d7daa8-03d4-4585-91ec-6e52a04a538f service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:20:03 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-b062c955-0f3a-4de9-bbc8-50bae4be91e4 req-b1d7daa8-03d4-4585-91ec-6e52a04a538f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:20:03 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-b062c955-0f3a-4de9-bbc8-50bae4be91e4 req-b1d7daa8-03d4-4585-91ec-6e52a04a538f service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:20:03 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-b062c955-0f3a-4de9-bbc8-50bae4be91e4 req-b1d7daa8-03d4-4585-91ec-6e52a04a538f service nova] Creating event network-vif-deleted:7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77 for instance d7931d89-3448-4dab-92aa-9804d72363ce on user Apr 17 11:20:03 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-b062c955-0f3a-4de9-bbc8-50bae4be91e4 req-b1d7daa8-03d4-4585-91ec-6e52a04a538f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034112 Apr 17 11:20:03 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 382/1140] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:20:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:20:04 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-870cc776-edfd-4bd1-8327-69d35aa96253 req-a6114823-67d2-4597-aa3e-142c4105a088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7931d89-3448-4dab-92aa-9804d72363ce", "name": "network-vif-plugged", "status": "completed", "tag": "7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:20:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-870cc776-edfd-4bd1-8327-69d35aa96253 req-a6114823-67d2-4597-aa3e-142c4105a088 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:20:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-870cc776-edfd-4bd1-8327-69d35aa96253 req-a6114823-67d2-4597-aa3e-142c4105a088 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:20:04 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-870cc776-edfd-4bd1-8327-69d35aa96253 req-a6114823-67d2-4597-aa3e-142c4105a088 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:20:04 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-870cc776-edfd-4bd1-8327-69d35aa96253 req-a6114823-67d2-4597-aa3e-142c4105a088 service nova] Creating event network-vif-plugged:7defac0f-e2b0-42c6-a5ab-a9f3f1a38a77 for instance d7931d89-3448-4dab-92aa-9804d72363ce on user Apr 17 11:20:04 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-870cc776-edfd-4bd1-8327-69d35aa96253 req-a6114823-67d2-4597-aa3e-142c4105a088 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029078 Apr 17 11:20:04 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 390/1141] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:20:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:20:41 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-429a2fe5-c4e6-429e-a586-c8e7280a56a4 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:20:41 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-429a2fe5-c4e6-429e-a586-c8e7280a56a4 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:20:41 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=8 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:20:41 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=12 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:20:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-429a2fe5-c4e6-429e-a586-c8e7280a56a4 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:20:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-429a2fe5-c4e6-429e-a586-c8e7280a56a4 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:20:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-429a2fe5-c4e6-429e-a586-c8e7280a56a4 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:20:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-429a2fe5-c4e6-429e-a586-c8e7280a56a4 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:20:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-429a2fe5-c4e6-429e-a586-c8e7280a56a4 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:20:41 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-429a2fe5-c4e6-429e-a586-c8e7280a56a4 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:20:41 user devstack@n-api.service[72744]: INFO nova.api.openstack.wsgi [None req-429a2fe5-c4e6-429e-a586-c8e7280a56a4 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] HTTP exception thrown: Instance 4368205b-a69c-49cd-958f-8f193856466a could not be found. Apr 17 11:20:41 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-429a2fe5-c4e6-429e-a586-c8e7280a56a4 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Request method failure captured: Apr 17 11:20:41 user devstack@n-api.service[72744]: request: GET /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a HTTP/1.1 Apr 17 11:20:41 user devstack@n-api.service[72744]: Accept: application/json Apr 17 11:20:41 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 11:20:41 user devstack@n-api.service[72744]: Connection: close Apr 17 11:20:41 user devstack@n-api.service[72744]: Content-Length: 0 Apr 17 11:20:41 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 11:20:41 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 11:20:41 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 11:20:41 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 11:20:41 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSkdNQlCQC0j_Scqt663u25JTKQ0VvHFR-Bs1WS4w1fclhhIe3uhdCjhS0GOk8WnVkAutnR7qqfJWjiB6gcAQZ5DHL7aRU3t4toaBkIvfpzRhhQyd8nAqMW--pdlYU2PLeANHC09fvmgTb5gEfrAhofFPyP8HzlyOsNLSJt_SNIjKTc Apr 17 11:20:41 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 11:20:41 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 11:20:41 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 11:20:41 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 11:20:41 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 11:20:41 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 11:20:41 user devstack@n-api.service[72744]: X-Project-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:20:41 user devstack@n-api.service[72744]: X-Project-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:20:41 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 11:20:41 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 11:20:41 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:20:41 user devstack@n-api.service[72744]: X-Tenant: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:20:41 user devstack@n-api.service[72744]: X-Tenant-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:20:41 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:20:41 user devstack@n-api.service[72744]: X-User: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:20:41 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 11:20:41 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 11:20:41 user devstack@n-api.service[72744]: X-User-Id: 8fc272a75798487d84beedfa65775423 Apr 17 11:20:41 user devstack@n-api.service[72744]: X-User-Name: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:20:41 user devstack@n-api.service[72744]: method: > Apr 17 11:20:41 user devstack@n-api.service[72744]: exception: Instance 4368205b-a69c-49cd-958f-8f193856466a could not be found. Apr 17 11:20:41 user devstack@n-api.service[72744]: action_args: {'id': '4368205b-a69c-49cd-958f-8f193856466a'} Apr 17 11:20:41 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4368205b-a69c-49cd-958f-8f193856466a could not be found. Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4368205b-a69c-49cd-958f-8f193856466a could not be found. Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4368205b-a69c-49cd-958f-8f193856466a could not be found. Apr 17 11:20:41 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:20:41 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-429a2fe5-c4e6-429e-a586-c8e7280a56a4 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Returning 404 to user: Instance 4368205b-a69c-49cd-958f-8f193856466a could not be found. {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:20:41 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-429a2fe5-c4e6-429e-a586-c8e7280a56a4 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a" status: 404 len: 111 microversion: 2.1 time: 0.039968 Apr 17 11:20:41 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 370/1142] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:20:41 2023] GET /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 11:20:41 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-4f9b490a-64be-4e50-9581-de9f6a58d891 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '.version_select at 0x7fc55aa39f30>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:20:41 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:20:41 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:20:41 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-4f9b490a-64be-4e50-9581-de9f6a58d891 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1991316860" status: 202 len: 0 microversion: 2.1 time: 0.033202 Apr 17 11:20:41 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 383/1143] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Apr 17 11:20:41 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1991316860 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 11:20:42 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-c1f2b732-2fcb-4319-83a1-344a2fecbba2 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Action: 'create', calling method: .version_select at 0x7fc55aa935b0>, body: {"keypair": {"name": "tempest-keypair-968594398", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4qah2EQ3/gXG23uGEJJi0SjaHzeSRjRdYjX7zfo8aLMEzvLdldhA8sGlVvRr0dPEc9Xfo5Hxf2kd/lwfKx9bue55cGB8lLxsLq2PmxzqElILsQT1hzHCO8ZJZmWCbh9A=="}} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:20:42 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:20:42 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:20:42 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-c1f2b732-2fcb-4319-83a1-344a2fecbba2 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Getting quotas for project 64eccc3b86914e4ab735b79c4b53a142. Resources: {'key_pairs'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 11:20:42 user devstack@n-api.service[72745]: DEBUG nova.quota [None req-c1f2b732-2fcb-4319-83a1-344a2fecbba2 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Getting quotas for user 8fc272a75798487d84beedfa65775423 and project 64eccc3b86914e4ab735b79c4b53a142. Resources: {'key_pairs'} {{(pid=72745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 11:20:42 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-c1f2b732-2fcb-4319-83a1-344a2fecbba2 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049733 Apr 17 11:20:42 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 391/1144] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 11:20:42 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:20:43 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1614419249", "imageRef": "66764afd-311a-41a0-a068-b2937b23acba", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce"}], "security_groups": [{"name": "tempest-securitygroup--434327736"}], "key_name": "tempest-keypair-968594398", "user_data": "}} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:20:43 user devstack@n-api.service[72744]: DEBUG nova.network.neutron [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] validate_networks() for [('7fbf1ab7-1c23-46b2-88b5-e2e5350ec5ce', None, None, None, None, None)] {{(pid=72744) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 11:20:44 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Flavor limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 11:20:44 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Image limits 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 11:20:44 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Flavor pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 11:20:44 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Image pref 0:0:0 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 11:20:44 user devstack@n-api.service[72744]: DEBUG nova.virt.hardware [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 11:20:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:20:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:20:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:20:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:20:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:20:44 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:20:44 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Getting quotas for project 64eccc3b86914e4ab735b79c4b53a142. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 11:20:44 user devstack@n-api.service[72744]: DEBUG nova.quota [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Getting quotas for user 8fc272a75798487d84beedfa65775423 and project 64eccc3b86914e4ab735b79c4b53a142. Resources: {'cores', 'instances', 'ram'} {{(pid=72744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 11:20:44 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Going to run 1 instances... {{(pid=72744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 11:20:44 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66764afd-311a-41a0-a068-b2937b23acba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 11:20:44 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-52896be0-3c77-42a2-9cf5-77a6d1377ca5 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.744842 Apr 17 11:20:44 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 371/1145] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 11:20:43 2023] POST /compute/v2.1/servers => generated 399 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 11:20:44 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-7eca9648-fb8d-49da-9f1c-a6e953068d31 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:20:44 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-7eca9648-fb8d-49da-9f1c-a6e953068d31 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:20:44 user devstack@n-api.service[72743]: DEBUG nova.policy [None req-7eca9648-fb8d-49da-9f1c-a6e953068d31 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc272a75798487d84beedfa65775423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eccc3b86914e4ab735b79c4b53a142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72743) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:20:44 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-7eca9648-fb8d-49da-9f1c-a6e953068d31 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818" status: 200 len: 1235 microversion: 2.1 time: 0.071096 Apr 17 11:20:44 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 384/1146] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:20:44 2023] GET /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818 => generated 1235 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:20:46 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-6dc8995b-f3cf-42ec-861b-a36df533a412 req-54e16337-6c09-40f6-ad73-af25c483b400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dcc9a9e-af00-4f79-add0-f4034f649818", "tag": "765fd187-4075-424c-a90f-4d1b86dadf0c"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:20:46 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-6dc8995b-f3cf-42ec-861b-a36df533a412 req-54e16337-6c09-40f6-ad73-af25c483b400 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:20:46 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-6dc8995b-f3cf-42ec-861b-a36df533a412 req-54e16337-6c09-40f6-ad73-af25c483b400 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:20:46 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-6dc8995b-f3cf-42ec-861b-a36df533a412 req-54e16337-6c09-40f6-ad73-af25c483b400 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:20:46 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-6dc8995b-f3cf-42ec-861b-a36df533a412 req-54e16337-6c09-40f6-ad73-af25c483b400 service nova] Creating event network-changed:765fd187-4075-424c-a90f-4d1b86dadf0c for instance 0dcc9a9e-af00-4f79-add0-f4034f649818 on user Apr 17 11:20:46 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-6dc8995b-f3cf-42ec-861b-a36df533a412 req-54e16337-6c09-40f6-ad73-af25c483b400 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029421 Apr 17 11:20:46 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 392/1147] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:20:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:20:49 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [req-7b8b2860-82bd-4584-aa21-feded3b3b5fb req-409e347a-371d-4ace-9dc7-d40cbd7e71ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dcc9a9e-af00-4f79-add0-f4034f649818", "name": "network-vif-plugged", "status": "completed", "tag": "765fd187-4075-424c-a90f-4d1b86dadf0c"}]} {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:20:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-7b8b2860-82bd-4584-aa21-feded3b3b5fb req-409e347a-371d-4ace-9dc7-d40cbd7e71ee service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:20:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-7b8b2860-82bd-4584-aa21-feded3b3b5fb req-409e347a-371d-4ace-9dc7-d40cbd7e71ee service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:20:49 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [req-7b8b2860-82bd-4584-aa21-feded3b3b5fb req-409e347a-371d-4ace-9dc7-d40cbd7e71ee service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:20:49 user devstack@n-api.service[72744]: INFO nova.api.openstack.compute.server_external_events [req-7b8b2860-82bd-4584-aa21-feded3b3b5fb req-409e347a-371d-4ace-9dc7-d40cbd7e71ee service nova] Creating event network-vif-plugged:765fd187-4075-424c-a90f-4d1b86dadf0c for instance 0dcc9a9e-af00-4f79-add0-f4034f649818 on user Apr 17 11:20:49 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [req-7b8b2860-82bd-4584-aa21-feded3b3b5fb req-409e347a-371d-4ace-9dc7-d40cbd7e71ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060508 Apr 17 11:20:49 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 372/1148] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:20:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 11:20:51 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-615e00e6-bdbb-4926-8794-b0742914fe1c req-5a4ce0a2-3f93-4501-98ce-087c5fe371ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dcc9a9e-af00-4f79-add0-f4034f649818", "name": "network-vif-plugged", "status": "completed", "tag": "765fd187-4075-424c-a90f-4d1b86dadf0c"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:20:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-615e00e6-bdbb-4926-8794-b0742914fe1c req-5a4ce0a2-3f93-4501-98ce-087c5fe371ef service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:20:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-615e00e6-bdbb-4926-8794-b0742914fe1c req-5a4ce0a2-3f93-4501-98ce-087c5fe371ef service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:20:51 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-615e00e6-bdbb-4926-8794-b0742914fe1c req-5a4ce0a2-3f93-4501-98ce-087c5fe371ef service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:20:51 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-615e00e6-bdbb-4926-8794-b0742914fe1c req-5a4ce0a2-3f93-4501-98ce-087c5fe371ef service nova] Creating event network-vif-plugged:765fd187-4075-424c-a90f-4d1b86dadf0c for instance 0dcc9a9e-af00-4f79-add0-f4034f649818 on user Apr 17 11:20:51 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-615e00e6-bdbb-4926-8794-b0742914fe1c req-5a4ce0a2-3f93-4501-98ce-087c5fe371ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028646 Apr 17 11:20:51 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 385/1149] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:20:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:20:52 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-f9828e29-640c-49b5-9528-30c13288940f tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:20:52 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-f9828e29-640c-49b5-9528-30c13288940f tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] [instance: d7931d89-3448-4dab-92aa-9804d72363ce] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:20:52 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell0:SELECT=4 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:20:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f9828e29-640c-49b5-9528-30c13288940f tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:20:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f9828e29-640c-49b5-9528-30c13288940f tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:20:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f9828e29-640c-49b5-9528-30c13288940f tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:20:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f9828e29-640c-49b5-9528-30c13288940f tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:20:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f9828e29-640c-49b5-9528-30c13288940f tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:20:52 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-f9828e29-640c-49b5-9528-30c13288940f tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:20:52 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-f9828e29-640c-49b5-9528-30c13288940f tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] HTTP exception thrown: Instance d7931d89-3448-4dab-92aa-9804d72363ce could not be found. Apr 17 11:20:52 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-f9828e29-640c-49b5-9528-30c13288940f tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Request method failure captured: Apr 17 11:20:52 user devstack@n-api.service[72745]: request: GET /compute/v2.1/servers/d7931d89-3448-4dab-92aa-9804d72363ce HTTP/1.1 Apr 17 11:20:52 user devstack@n-api.service[72745]: Accept: application/json Apr 17 11:20:52 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 11:20:52 user devstack@n-api.service[72745]: Connection: close Apr 17 11:20:52 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 11:20:52 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 11:20:52 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 11:20:52 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 11:20:52 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 11:20:52 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSrw1nYpf0kV8-JP_714RFTZxTk7FUKNjjpXrLU187ZIVJUOeFKeYMbQAGRsQCpmjJYSmboWlGPH5E6xOTjVA2rbHXuBErvgP4KbUlmkfL5skb47b2rr6h-EqYzQKYeVJ6Im3xDl5t4spnaqSE1kIGwSqHkDE_3IWbw8cBEuntfQmJU Apr 17 11:20:52 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 11:20:52 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 11:20:52 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 11:20:52 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 11:20:52 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 11:20:52 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 11:20:52 user devstack@n-api.service[72745]: X-Project-Id: 8b8e27f859154b75814c80a52166ba1e Apr 17 11:20:52 user devstack@n-api.service[72745]: X-Project-Name: tempest-VolumesNegativeTest-1239676705 Apr 17 11:20:52 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 11:20:52 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 11:20:52 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8b8e27f859154b75814c80a52166ba1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8b8e27f859154b75814c80a52166ba1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8b8e27f859154b75814c80a52166ba1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:20:52 user devstack@n-api.service[72745]: X-Tenant: tempest-VolumesNegativeTest-1239676705 Apr 17 11:20:52 user devstack@n-api.service[72745]: X-Tenant-Id: 8b8e27f859154b75814c80a52166ba1e Apr 17 11:20:52 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-VolumesNegativeTest-1239676705 Apr 17 11:20:52 user devstack@n-api.service[72745]: X-User: tempest-VolumesNegativeTest-1239676705-project-member Apr 17 11:20:52 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 11:20:52 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 11:20:52 user devstack@n-api.service[72745]: X-User-Id: 819b4316675948e7b0bc8d05d47b57a3 Apr 17 11:20:52 user devstack@n-api.service[72745]: X-User-Name: tempest-VolumesNegativeTest-1239676705-project-member Apr 17 11:20:52 user devstack@n-api.service[72745]: method: > Apr 17 11:20:52 user devstack@n-api.service[72745]: exception: Instance d7931d89-3448-4dab-92aa-9804d72363ce could not be found. Apr 17 11:20:52 user devstack@n-api.service[72745]: action_args: {'id': 'd7931d89-3448-4dab-92aa-9804d72363ce'} Apr 17 11:20:52 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7931d89-3448-4dab-92aa-9804d72363ce could not be found. Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7931d89-3448-4dab-92aa-9804d72363ce could not be found. Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7931d89-3448-4dab-92aa-9804d72363ce could not be found. Apr 17 11:20:52 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:20:52 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-f9828e29-640c-49b5-9528-30c13288940f tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] Returning 404 to user: Instance d7931d89-3448-4dab-92aa-9804d72363ce could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:20:52 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-f9828e29-640c-49b5-9528-30c13288940f tempest-VolumesNegativeTest-1239676705 tempest-VolumesNegativeTest-1239676705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7931d89-3448-4dab-92aa-9804d72363ce" status: 404 len: 111 microversion: 2.1 time: 0.033381 Apr 17 11:20:52 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 393/1150] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:20:52 2023] GET /compute/v2.1/servers/d7931d89-3448-4dab-92aa-9804d72363ce => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 11:21:34 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:21:34 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell0:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:21:34 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:21:34 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:21:34 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-c5b572f4-1887-45d9-bc89-fb2f1029687c tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:21:34 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-c5b572f4-1887-45d9-bc89-fb2f1029687c tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:21:34 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-c5b572f4-1887-45d9-bc89-fb2f1029687c tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:21:34 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-c5b572f4-1887-45d9-bc89-fb2f1029687c tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:21:34 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-c5b572f4-1887-45d9-bc89-fb2f1029687c tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:21:34 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-c5b572f4-1887-45d9-bc89-fb2f1029687c tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:21:34 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-c5b572f4-1887-45d9-bc89-fb2f1029687c tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:21:34 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-c5b572f4-1887-45d9-bc89-fb2f1029687c tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:21:35 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-c5b572f4-1887-45d9-bc89-fb2f1029687c tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc272a75798487d84beedfa65775423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eccc3b86914e4ab735b79c4b53a142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:21:35 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-c5b572f4-1887-45d9-bc89-fb2f1029687c tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818" status: 200 len: 1543 microversion: 2.1 time: 0.416921 Apr 17 11:21:35 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 373/1151] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:21:34 2023] GET /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818 => generated 1543 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:22:35 user devstack@n-api.service[72743]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bfde3760-db26-48c3-903e-e2c58e974c03] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 17 11:22:35 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell0:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:22:35 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:22:35 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=2 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:22:35 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-71d4a337-54bf-4c09-8161-6d35a2a22c31 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:22:35 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-71d4a337-54bf-4c09-8161-6d35a2a22c31 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:22:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-71d4a337-54bf-4c09-8161-6d35a2a22c31 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:22:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-71d4a337-54bf-4c09-8161-6d35a2a22c31 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:22:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-71d4a337-54bf-4c09-8161-6d35a2a22c31 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:22:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-71d4a337-54bf-4c09-8161-6d35a2a22c31 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:22:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-71d4a337-54bf-4c09-8161-6d35a2a22c31 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:22:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-71d4a337-54bf-4c09-8161-6d35a2a22c31 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:22:35 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-71d4a337-54bf-4c09-8161-6d35a2a22c31 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.349118 Apr 17 11:22:35 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 386/1152] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 17 11:22:35 2023] GET /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818/os-interface => generated 282 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:22:36 user devstack@n-api.service[72745]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a6512bb3-50d1-485e-9503-ae2677ff2705] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 17 11:22:36 user devstack@n-api.service[72745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 17 11:22:36 user devstack@n-api.service[72745]: Mon Apr 17 11:22:36 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 17 11:22:36 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:22:36 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=4 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:22:36 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-3ef252b9-aee4-4643-8cd5-a8a96811118c req-c2a46ae4-b0a3-4938-bae5-b8b9c7b71052 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dcc9a9e-af00-4f79-add0-f4034f649818", "tag": "765fd187-4075-424c-a90f-4d1b86dadf0c"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:22:36 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-3ef252b9-aee4-4643-8cd5-a8a96811118c req-c2a46ae4-b0a3-4938-bae5-b8b9c7b71052 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:22:36 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-3ef252b9-aee4-4643-8cd5-a8a96811118c req-c2a46ae4-b0a3-4938-bae5-b8b9c7b71052 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:22:36 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-3ef252b9-aee4-4643-8cd5-a8a96811118c req-c2a46ae4-b0a3-4938-bae5-b8b9c7b71052 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:22:36 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:22:36 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:22:36 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-d8e06101-a982-4686-a74c-106f1d1b5ebc tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:22:36 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-d8e06101-a982-4686-a74c-106f1d1b5ebc tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:22:36 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-3ef252b9-aee4-4643-8cd5-a8a96811118c req-c2a46ae4-b0a3-4938-bae5-b8b9c7b71052 service nova] Creating event network-changed:765fd187-4075-424c-a90f-4d1b86dadf0c for instance 0dcc9a9e-af00-4f79-add0-f4034f649818 on user Apr 17 11:22:36 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d8e06101-a982-4686-a74c-106f1d1b5ebc tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:22:36 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d8e06101-a982-4686-a74c-106f1d1b5ebc tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:22:36 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d8e06101-a982-4686-a74c-106f1d1b5ebc tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:22:36 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d8e06101-a982-4686-a74c-106f1d1b5ebc tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:22:36 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d8e06101-a982-4686-a74c-106f1d1b5ebc tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:22:36 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-d8e06101-a982-4686-a74c-106f1d1b5ebc tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:22:36 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-3ef252b9-aee4-4643-8cd5-a8a96811118c req-c2a46ae4-b0a3-4938-bae5-b8b9c7b71052 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075690 Apr 17 11:22:36 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 394/1153] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:22:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:22:36 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-d8e06101-a982-4686-a74c-106f1d1b5ebc tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818/ips" status: 200 len: 107 microversion: 2.1 time: 0.044576 Apr 17 11:22:36 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 374/1154] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 17 11:22:36 2023] GET /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818/ips => generated 107 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:22:38 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7377e17-365c-4d28-abbd-013c80b6308f"}} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:22:38 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:22:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:22:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:22:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:22:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:22:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:22:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:22:38 user devstack@n-api.service[72743]: INFO oslo.messaging._drivers.impl_rabbit [-] [bfde3760-db26-48c3-903e-e2c58e974c03] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 45130. Apr 17 11:22:39 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-327f922e-11f5-4d9d-89d6-d6832244f981 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298939 Apr 17 11:22:39 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 387/1155] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Apr 17 11:22:38 2023] POST /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:22:46 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:22:46 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:22:46 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:22:46 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:22:46 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:22:46 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:22:46 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:22:46 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:22:46 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:22:46 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:22:46 user devstack@n-api.service[72745]: INFO oslo.messaging._drivers.impl_rabbit [-] [a6512bb3-50d1-485e-9503-ae2677ff2705] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 52910. Apr 17 11:22:46 user devstack@n-api.service[72745]: DEBUG nova.objects.instance [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lazy-loading 'services' on Instance uuid 0dcc9a9e-af00-4f79-add0-f4034f649818 {{(pid=72745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 11:22:47 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-e4362cf1-2bca-4711-a81e-d8eb64f5d4e7 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818/os-volume_attachments/e7377e17-365c-4d28-abbd-013c80b6308f" status: 202 len: 0 microversion: 2.1 time: 0.383911 Apr 17 11:22:47 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 395/1156] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Apr 17 11:22:46 2023] DELETE /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818/os-volume_attachments/e7377e17-365c-4d28-abbd-013c80b6308f => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 11:22:47 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:22:47 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=4 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:22:47 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-e51445ce-8e13-4834-ad87-78dcfc6b2b2f tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:22:47 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-e51445ce-8e13-4834-ad87-78dcfc6b2b2f tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:22:47 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e51445ce-8e13-4834-ad87-78dcfc6b2b2f tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:22:47 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e51445ce-8e13-4834-ad87-78dcfc6b2b2f tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:22:47 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e51445ce-8e13-4834-ad87-78dcfc6b2b2f tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:22:47 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e51445ce-8e13-4834-ad87-78dcfc6b2b2f tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:22:47 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e51445ce-8e13-4834-ad87-78dcfc6b2b2f tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:22:47 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-e51445ce-8e13-4834-ad87-78dcfc6b2b2f tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:22:47 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-e51445ce-8e13-4834-ad87-78dcfc6b2b2f tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065487 Apr 17 11:22:47 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 375/1157] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 11:22:47 2023] GET /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:23:37 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-821ee4e7-7cec-4119-a60b-295641b14b8a tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:23:37 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-821ee4e7-7cec-4119-a60b-295641b14b8a tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:23:37 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=4 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:23:37 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:23:37 user devstack@n-api.service[72743]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 17 11:23:37 user devstack@n-api.service[72743]: Mon Apr 17 11:23:37 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818/os-volume_attachments (ip 10.0.0.210) !!! Apr 17 11:23:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-821ee4e7-7cec-4119-a60b-295641b14b8a tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:23:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-821ee4e7-7cec-4119-a60b-295641b14b8a tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:23:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-821ee4e7-7cec-4119-a60b-295641b14b8a tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:23:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-821ee4e7-7cec-4119-a60b-295641b14b8a tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:23:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-821ee4e7-7cec-4119-a60b-295641b14b8a tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:23:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-821ee4e7-7cec-4119-a60b-295641b14b8a tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:23:37 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-821ee4e7-7cec-4119-a60b-295641b14b8a tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063008 Apr 17 11:23:37 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 388/1158] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Apr 17 11:23:37 2023] GET /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 17 11:23:37 user devstack@n-api.service[72745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 17 11:23:37 user devstack@n-api.service[72745]: Mon Apr 17 11:23:37 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818 (ip 10.0.0.210) !!! Apr 17 11:23:37 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=2 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:23:37 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:23:37 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:23:37 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:23:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:23:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:23:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:23:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:23:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:23:37 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:23:37 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Going to try to terminate instance {{(pid=72745) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 11:23:37 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-9773563a-7632-4e83-a4e2-100aee0ead68 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818" status: 204 len: 0 microversion: 2.1 time: 0.156951 Apr 17 11:23:37 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 396/1159] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 11:23:37 2023] DELETE /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 11:23:37 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-f4740723-c3c2-44dd-83ed-82c348ab9cac tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:23:37 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-f4740723-c3c2-44dd-83ed-82c348ab9cac tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:23:37 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:23:37 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:23:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f4740723-c3c2-44dd-83ed-82c348ab9cac tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:23:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f4740723-c3c2-44dd-83ed-82c348ab9cac tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:23:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f4740723-c3c2-44dd-83ed-82c348ab9cac tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:23:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f4740723-c3c2-44dd-83ed-82c348ab9cac tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:23:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f4740723-c3c2-44dd-83ed-82c348ab9cac tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:23:37 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-f4740723-c3c2-44dd-83ed-82c348ab9cac tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:23:37 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [req-87ab5b17-2c65-4bf6-b784-849101b56eef req-6bfe78db-1baf-4834-ae95-f3f5a1e07c80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dcc9a9e-af00-4f79-add0-f4034f649818", "name": "network-vif-unplugged", "status": "completed", "tag": "765fd187-4075-424c-a90f-4d1b86dadf0c"}]} {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:23:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-87ab5b17-2c65-4bf6-b784-849101b56eef req-6bfe78db-1baf-4834-ae95-f3f5a1e07c80 service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:23:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-87ab5b17-2c65-4bf6-b784-849101b56eef req-6bfe78db-1baf-4834-ae95-f3f5a1e07c80 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:23:37 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [req-87ab5b17-2c65-4bf6-b784-849101b56eef req-6bfe78db-1baf-4834-ae95-f3f5a1e07c80 service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:23:37 user devstack@n-api.service[72743]: INFO nova.api.openstack.compute.server_external_events [req-87ab5b17-2c65-4bf6-b784-849101b56eef req-6bfe78db-1baf-4834-ae95-f3f5a1e07c80 service nova] Creating event network-vif-unplugged:765fd187-4075-424c-a90f-4d1b86dadf0c for instance 0dcc9a9e-af00-4f79-add0-f4034f649818 on user Apr 17 11:23:37 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [req-87ab5b17-2c65-4bf6-b784-849101b56eef req-6bfe78db-1baf-4834-ae95-f3f5a1e07c80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089639 Apr 17 11:23:37 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 389/1160] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:23:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:23:37 user devstack@n-api.service[72744]: DEBUG nova.policy [None req-f4740723-c3c2-44dd-83ed-82c348ab9cac tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc272a75798487d84beedfa65775423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eccc3b86914e4ab735b79c4b53a142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72744) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 11:23:37 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-f4740723-c3c2-44dd-83ed-82c348ab9cac tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818" status: 200 len: 1668 microversion: 2.1 time: 0.478879 Apr 17 11:23:37 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 376/1161] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:23:37 2023] GET /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818 => generated 1668 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 11:23:39 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [req-7cb9a6af-61e6-4ef1-830b-189993b49521 req-8f214e39-ff09-442b-a4ea-308bc1a30b3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dcc9a9e-af00-4f79-add0-f4034f649818", "name": "network-vif-plugged", "status": "completed", "tag": "765fd187-4075-424c-a90f-4d1b86dadf0c"}, {"server_uuid": "0dcc9a9e-af00-4f79-add0-f4034f649818", "name": "network-vif-deleted", "tag": "765fd187-4075-424c-a90f-4d1b86dadf0c"}]} {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 11:23:39 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-7cb9a6af-61e6-4ef1-830b-189993b49521 req-8f214e39-ff09-442b-a4ea-308bc1a30b3e service nova] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:23:39 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-7cb9a6af-61e6-4ef1-830b-189993b49521 req-8f214e39-ff09-442b-a4ea-308bc1a30b3e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:23:39 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [req-7cb9a6af-61e6-4ef1-830b-189993b49521 req-8f214e39-ff09-442b-a4ea-308bc1a30b3e service nova] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:23:39 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-7cb9a6af-61e6-4ef1-830b-189993b49521 req-8f214e39-ff09-442b-a4ea-308bc1a30b3e service nova] Creating event network-vif-plugged:765fd187-4075-424c-a90f-4d1b86dadf0c for instance 0dcc9a9e-af00-4f79-add0-f4034f649818 on user Apr 17 11:23:39 user devstack@n-api.service[72745]: INFO nova.api.openstack.compute.server_external_events [req-7cb9a6af-61e6-4ef1-830b-189993b49521 req-8f214e39-ff09-442b-a4ea-308bc1a30b3e service nova] Creating event network-vif-deleted:765fd187-4075-424c-a90f-4d1b86dadf0c for instance 0dcc9a9e-af00-4f79-add0-f4034f649818 on user Apr 17 11:23:39 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [req-7cb9a6af-61e6-4ef1-830b-189993b49521 req-8f214e39-ff09-442b-a4ea-308bc1a30b3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032837 Apr 17 11:23:39 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 397/1162] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 11:23:39 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 11:24:28 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_api:SELECT=4 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:24:28 user devstack@n-api.service[72743]: DEBUG dbcounter [-] [72743] Writing DB stats nova_cell1:SELECT=8 {{(pid=72743) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:24:28 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-eb31d9eb-021d-4e33-881e-a7002e38a8e6 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:24:28 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-eb31d9eb-021d-4e33-881e-a7002e38a8e6 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:24:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-eb31d9eb-021d-4e33-881e-a7002e38a8e6 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:24:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-eb31d9eb-021d-4e33-881e-a7002e38a8e6 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:24:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-eb31d9eb-021d-4e33-881e-a7002e38a8e6 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:24:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-eb31d9eb-021d-4e33-881e-a7002e38a8e6 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:24:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-eb31d9eb-021d-4e33-881e-a7002e38a8e6 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:24:28 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-eb31d9eb-021d-4e33-881e-a7002e38a8e6 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:24:28 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-eb31d9eb-021d-4e33-881e-a7002e38a8e6 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] HTTP exception thrown: Instance 0dcc9a9e-af00-4f79-add0-f4034f649818 could not be found. Apr 17 11:24:28 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-eb31d9eb-021d-4e33-881e-a7002e38a8e6 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Request method failure captured: Apr 17 11:24:28 user devstack@n-api.service[72743]: request: GET /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818 HTTP/1.1 Apr 17 11:24:28 user devstack@n-api.service[72743]: Accept: application/json Apr 17 11:24:28 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 11:24:28 user devstack@n-api.service[72743]: Connection: close Apr 17 11:24:28 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 11:24:28 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 11:24:28 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 11:24:28 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 11:24:28 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 11:24:28 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSkdNQlCQC0j_Scqt663u25JTKQ0VvHFR-Bs1WS4w1fclhhIe3uhdCjhS0GOk8WnVkAutnR7qqfJWjiB6gcAQZ5DHL7aRU3t4toaBkIvfpzRhhQyd8nAqMW--pdlYU2PLeANHC09fvmgTb5gEfrAhofFPyP8HzlyOsNLSJt_SNIjKTc Apr 17 11:24:28 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 11:24:28 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 11:24:28 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 11:24:28 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 11:24:28 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 11:24:28 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 11:24:28 user devstack@n-api.service[72743]: X-Project-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:24:28 user devstack@n-api.service[72743]: X-Project-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:24:28 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 11:24:28 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 11:24:28 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:24:28 user devstack@n-api.service[72743]: X-Tenant: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:24:28 user devstack@n-api.service[72743]: X-Tenant-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:24:28 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:24:28 user devstack@n-api.service[72743]: X-User: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:24:28 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 11:24:28 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 11:24:28 user devstack@n-api.service[72743]: X-User-Id: 8fc272a75798487d84beedfa65775423 Apr 17 11:24:28 user devstack@n-api.service[72743]: X-User-Name: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:24:28 user devstack@n-api.service[72743]: method: > Apr 17 11:24:28 user devstack@n-api.service[72743]: exception: Instance 0dcc9a9e-af00-4f79-add0-f4034f649818 could not be found. Apr 17 11:24:28 user devstack@n-api.service[72743]: action_args: {'id': '0dcc9a9e-af00-4f79-add0-f4034f649818'} Apr 17 11:24:28 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dcc9a9e-af00-4f79-add0-f4034f649818 could not be found. Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dcc9a9e-af00-4f79-add0-f4034f649818 could not be found. Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dcc9a9e-af00-4f79-add0-f4034f649818 could not be found. Apr 17 11:24:28 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:24:28 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-eb31d9eb-021d-4e33-881e-a7002e38a8e6 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Returning 404 to user: Instance 0dcc9a9e-af00-4f79-add0-f4034f649818 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:24:28 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-eb31d9eb-021d-4e33-881e-a7002e38a8e6 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818" status: 404 len: 111 microversion: 2.1 time: 0.037008 Apr 17 11:24:28 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 390/1163] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:24:28 2023] GET /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 11:24:28 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-2be4e5ea-03bf-4b96-9206-11d64efad648 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '.version_select at 0x7fc55aaa0ee0>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:24:28 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_api:SELECT=2 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:24:28 user devstack@n-api.service[72744]: DEBUG dbcounter [-] [72744] Writing DB stats nova_cell1:SELECT=6 {{(pid=72744) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:24:28 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-2be4e5ea-03bf-4b96-9206-11d64efad648 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-968594398" status: 202 len: 0 microversion: 2.1 time: 0.032650 Apr 17 11:24:28 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 377/1164] 10.0.0.210 () {62 vars in 1295 bytes} [Mon Apr 17 11:24:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-968594398 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 11:24:32 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:24:32 user devstack@n-api.service[72745]: DEBUG dbcounter [-] [72745] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72745) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 11:24:32 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-69eccb96-f295-43df-bc3e-ff5ec1474225 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:24:32 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-69eccb96-f295-43df-bc3e-ff5ec1474225 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:24:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-69eccb96-f295-43df-bc3e-ff5ec1474225 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:24:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-69eccb96-f295-43df-bc3e-ff5ec1474225 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:24:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-69eccb96-f295-43df-bc3e-ff5ec1474225 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:24:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-69eccb96-f295-43df-bc3e-ff5ec1474225 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:24:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-69eccb96-f295-43df-bc3e-ff5ec1474225 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:24:32 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-69eccb96-f295-43df-bc3e-ff5ec1474225 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:24:32 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-69eccb96-f295-43df-bc3e-ff5ec1474225 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] HTTP exception thrown: Instance 0dcc9a9e-af00-4f79-add0-f4034f649818 could not be found. Apr 17 11:24:32 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-69eccb96-f295-43df-bc3e-ff5ec1474225 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Request method failure captured: Apr 17 11:24:32 user devstack@n-api.service[72745]: request: DELETE /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818 HTTP/1.1 Apr 17 11:24:32 user devstack@n-api.service[72745]: Accept: application/json Apr 17 11:24:32 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 11:24:32 user devstack@n-api.service[72745]: Connection: close Apr 17 11:24:32 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 11:24:32 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 11:24:32 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 11:24:32 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 11:24:32 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 11:24:32 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSkdNQlCQC0j_Scqt663u25JTKQ0VvHFR-Bs1WS4w1fclhhIe3uhdCjhS0GOk8WnVkAutnR7qqfJWjiB6gcAQZ5DHL7aRU3t4toaBkIvfpzRhhQyd8nAqMW--pdlYU2PLeANHC09fvmgTb5gEfrAhofFPyP8HzlyOsNLSJt_SNIjKTc Apr 17 11:24:32 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 11:24:32 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 11:24:32 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 11:24:32 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 11:24:32 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 11:24:32 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 11:24:32 user devstack@n-api.service[72745]: X-Project-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:24:32 user devstack@n-api.service[72745]: X-Project-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:24:32 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 11:24:32 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 11:24:32 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:24:32 user devstack@n-api.service[72745]: X-Tenant: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:24:32 user devstack@n-api.service[72745]: X-Tenant-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:24:32 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:24:32 user devstack@n-api.service[72745]: X-User: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:24:32 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 11:24:32 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 11:24:32 user devstack@n-api.service[72745]: X-User-Id: 8fc272a75798487d84beedfa65775423 Apr 17 11:24:32 user devstack@n-api.service[72745]: X-User-Name: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:24:32 user devstack@n-api.service[72745]: method: > Apr 17 11:24:32 user devstack@n-api.service[72745]: exception: Instance 0dcc9a9e-af00-4f79-add0-f4034f649818 could not be found. Apr 17 11:24:32 user devstack@n-api.service[72745]: action_args: {'id': '0dcc9a9e-af00-4f79-add0-f4034f649818'} Apr 17 11:24:32 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dcc9a9e-af00-4f79-add0-f4034f649818 could not be found. Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dcc9a9e-af00-4f79-add0-f4034f649818 could not be found. Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dcc9a9e-af00-4f79-add0-f4034f649818 could not be found. Apr 17 11:24:32 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:24:32 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-69eccb96-f295-43df-bc3e-ff5ec1474225 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Returning 404 to user: Instance 0dcc9a9e-af00-4f79-add0-f4034f649818 could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:24:32 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-69eccb96-f295-43df-bc3e-ff5ec1474225 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818" status: 404 len: 111 microversion: 2.1 time: 0.037433 Apr 17 11:24:32 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 398/1165] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 11:24:32 2023] DELETE /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 11:24:32 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b2268c12-a1fb-4050-a9ca-424a53499944 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:24:32 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-b2268c12-a1fb-4050-a9ca-424a53499944 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 0dcc9a9e-af00-4f79-add0-f4034f649818] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:24:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b2268c12-a1fb-4050-a9ca-424a53499944 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:24:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b2268c12-a1fb-4050-a9ca-424a53499944 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:24:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b2268c12-a1fb-4050-a9ca-424a53499944 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:24:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b2268c12-a1fb-4050-a9ca-424a53499944 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:24:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b2268c12-a1fb-4050-a9ca-424a53499944 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:24:32 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-b2268c12-a1fb-4050-a9ca-424a53499944 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:24:32 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-b2268c12-a1fb-4050-a9ca-424a53499944 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] HTTP exception thrown: Instance 0dcc9a9e-af00-4f79-add0-f4034f649818 could not be found. Apr 17 11:24:32 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b2268c12-a1fb-4050-a9ca-424a53499944 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Request method failure captured: Apr 17 11:24:32 user devstack@n-api.service[72743]: request: GET /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818 HTTP/1.1 Apr 17 11:24:32 user devstack@n-api.service[72743]: Accept: application/json Apr 17 11:24:32 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 11:24:32 user devstack@n-api.service[72743]: Connection: close Apr 17 11:24:32 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 11:24:32 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 11:24:32 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 11:24:32 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 11:24:32 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 11:24:32 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSkdNQlCQC0j_Scqt663u25JTKQ0VvHFR-Bs1WS4w1fclhhIe3uhdCjhS0GOk8WnVkAutnR7qqfJWjiB6gcAQZ5DHL7aRU3t4toaBkIvfpzRhhQyd8nAqMW--pdlYU2PLeANHC09fvmgTb5gEfrAhofFPyP8HzlyOsNLSJt_SNIjKTc Apr 17 11:24:32 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 11:24:32 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 11:24:32 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 11:24:32 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 11:24:32 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 11:24:32 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 11:24:32 user devstack@n-api.service[72743]: X-Project-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:24:32 user devstack@n-api.service[72743]: X-Project-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:24:32 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 11:24:32 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 11:24:32 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:24:32 user devstack@n-api.service[72743]: X-Tenant: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:24:32 user devstack@n-api.service[72743]: X-Tenant-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:24:32 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:24:32 user devstack@n-api.service[72743]: X-User: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:24:32 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 11:24:32 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 11:24:32 user devstack@n-api.service[72743]: X-User-Id: 8fc272a75798487d84beedfa65775423 Apr 17 11:24:32 user devstack@n-api.service[72743]: X-User-Name: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:24:32 user devstack@n-api.service[72743]: method: > Apr 17 11:24:32 user devstack@n-api.service[72743]: exception: Instance 0dcc9a9e-af00-4f79-add0-f4034f649818 could not be found. Apr 17 11:24:32 user devstack@n-api.service[72743]: action_args: {'id': '0dcc9a9e-af00-4f79-add0-f4034f649818'} Apr 17 11:24:32 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dcc9a9e-af00-4f79-add0-f4034f649818 could not be found. Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dcc9a9e-af00-4f79-add0-f4034f649818 could not be found. Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dcc9a9e-af00-4f79-add0-f4034f649818 could not be found. Apr 17 11:24:32 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:24:32 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-b2268c12-a1fb-4050-a9ca-424a53499944 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Returning 404 to user: Instance 0dcc9a9e-af00-4f79-add0-f4034f649818 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:24:32 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-b2268c12-a1fb-4050-a9ca-424a53499944 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818" status: 404 len: 111 microversion: 2.1 time: 0.026385 Apr 17 11:24:32 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 391/1166] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:24:32 2023] GET /compute/v2.1/servers/0dcc9a9e-af00-4f79-add0-f4034f649818 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f92f1ff5-09c5-4013-a194-a7c08cf2f27b] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 17 11:24:35 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-1ba3d730-46d1-4900-941f-b0e38fb62008 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:24:35 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-1ba3d730-46d1-4900-941f-b0e38fb62008 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:24:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1ba3d730-46d1-4900-941f-b0e38fb62008 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:24:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1ba3d730-46d1-4900-941f-b0e38fb62008 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:24:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1ba3d730-46d1-4900-941f-b0e38fb62008 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:24:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1ba3d730-46d1-4900-941f-b0e38fb62008 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:24:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1ba3d730-46d1-4900-941f-b0e38fb62008 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:24:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-1ba3d730-46d1-4900-941f-b0e38fb62008 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:24:35 user devstack@n-api.service[72744]: INFO nova.api.openstack.wsgi [None req-1ba3d730-46d1-4900-941f-b0e38fb62008 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] HTTP exception thrown: Instance 4368205b-a69c-49cd-958f-8f193856466a could not be found. Apr 17 11:24:35 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-1ba3d730-46d1-4900-941f-b0e38fb62008 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Request method failure captured: Apr 17 11:24:35 user devstack@n-api.service[72744]: request: DELETE /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a HTTP/1.1 Apr 17 11:24:35 user devstack@n-api.service[72744]: Accept: application/json Apr 17 11:24:35 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 11:24:35 user devstack@n-api.service[72744]: Connection: close Apr 17 11:24:35 user devstack@n-api.service[72744]: Content-Length: 0 Apr 17 11:24:35 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 11:24:35 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 11:24:35 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 11:24:35 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSkdNQlCQC0j_Scqt663u25JTKQ0VvHFR-Bs1WS4w1fclhhIe3uhdCjhS0GOk8WnVkAutnR7qqfJWjiB6gcAQZ5DHL7aRU3t4toaBkIvfpzRhhQyd8nAqMW--pdlYU2PLeANHC09fvmgTb5gEfrAhofFPyP8HzlyOsNLSJt_SNIjKTc Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Project-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Project-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Tenant: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Tenant-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:24:35 user devstack@n-api.service[72744]: X-User: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:24:35 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 11:24:35 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 11:24:35 user devstack@n-api.service[72744]: X-User-Id: 8fc272a75798487d84beedfa65775423 Apr 17 11:24:35 user devstack@n-api.service[72744]: X-User-Name: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:24:35 user devstack@n-api.service[72744]: method: > Apr 17 11:24:35 user devstack@n-api.service[72744]: exception: Instance 4368205b-a69c-49cd-958f-8f193856466a could not be found. Apr 17 11:24:35 user devstack@n-api.service[72744]: action_args: {'id': '4368205b-a69c-49cd-958f-8f193856466a'} Apr 17 11:24:35 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4368205b-a69c-49cd-958f-8f193856466a could not be found. Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4368205b-a69c-49cd-958f-8f193856466a could not be found. Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4368205b-a69c-49cd-958f-8f193856466a could not be found. Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:24:35 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-1ba3d730-46d1-4900-941f-b0e38fb62008 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Returning 404 to user: Instance 4368205b-a69c-49cd-958f-8f193856466a could not be found. {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:24:35 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-1ba3d730-46d1-4900-941f-b0e38fb62008 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a" status: 404 len: 111 microversion: 2.1 time: 0.031735 Apr 17 11:24:35 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 378/1167] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 11:24:35 2023] DELETE /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 11:24:35 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-c62bbaef-2055-4525-bb1b-cf05dcde4138 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:24:35 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-c62bbaef-2055-4525-bb1b-cf05dcde4138 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 4368205b-a69c-49cd-958f-8f193856466a] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:24:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c62bbaef-2055-4525-bb1b-cf05dcde4138 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:24:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c62bbaef-2055-4525-bb1b-cf05dcde4138 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:24:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c62bbaef-2055-4525-bb1b-cf05dcde4138 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:24:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c62bbaef-2055-4525-bb1b-cf05dcde4138 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:24:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c62bbaef-2055-4525-bb1b-cf05dcde4138 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:24:35 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-c62bbaef-2055-4525-bb1b-cf05dcde4138 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:24:35 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-c62bbaef-2055-4525-bb1b-cf05dcde4138 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] HTTP exception thrown: Instance 4368205b-a69c-49cd-958f-8f193856466a could not be found. Apr 17 11:24:35 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-c62bbaef-2055-4525-bb1b-cf05dcde4138 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Request method failure captured: Apr 17 11:24:35 user devstack@n-api.service[72745]: request: GET /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a HTTP/1.1 Apr 17 11:24:35 user devstack@n-api.service[72745]: Accept: application/json Apr 17 11:24:35 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 11:24:35 user devstack@n-api.service[72745]: Connection: close Apr 17 11:24:35 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 11:24:35 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 11:24:35 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 11:24:35 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 11:24:35 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 11:24:35 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSkdNQlCQC0j_Scqt663u25JTKQ0VvHFR-Bs1WS4w1fclhhIe3uhdCjhS0GOk8WnVkAutnR7qqfJWjiB6gcAQZ5DHL7aRU3t4toaBkIvfpzRhhQyd8nAqMW--pdlYU2PLeANHC09fvmgTb5gEfrAhofFPyP8HzlyOsNLSJt_SNIjKTc Apr 17 11:24:35 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 11:24:35 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 11:24:35 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 11:24:35 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 11:24:35 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 11:24:35 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 11:24:35 user devstack@n-api.service[72745]: X-Project-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:24:35 user devstack@n-api.service[72745]: X-Project-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:24:35 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 11:24:35 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 11:24:35 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:24:35 user devstack@n-api.service[72745]: X-Tenant: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:24:35 user devstack@n-api.service[72745]: X-Tenant-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:24:35 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:24:35 user devstack@n-api.service[72745]: X-User: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:24:35 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 11:24:35 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 11:24:35 user devstack@n-api.service[72745]: X-User-Id: 8fc272a75798487d84beedfa65775423 Apr 17 11:24:35 user devstack@n-api.service[72745]: X-User-Name: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:24:35 user devstack@n-api.service[72745]: method: > Apr 17 11:24:35 user devstack@n-api.service[72745]: exception: Instance 4368205b-a69c-49cd-958f-8f193856466a could not be found. Apr 17 11:24:35 user devstack@n-api.service[72745]: action_args: {'id': '4368205b-a69c-49cd-958f-8f193856466a'} Apr 17 11:24:35 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4368205b-a69c-49cd-958f-8f193856466a could not be found. Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4368205b-a69c-49cd-958f-8f193856466a could not be found. Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4368205b-a69c-49cd-958f-8f193856466a could not be found. Apr 17 11:24:35 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:24:35 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-c62bbaef-2055-4525-bb1b-cf05dcde4138 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Returning 404 to user: Instance 4368205b-a69c-49cd-958f-8f193856466a could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:24:35 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-c62bbaef-2055-4525-bb1b-cf05dcde4138 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a" status: 404 len: 111 microversion: 2.1 time: 0.027701 Apr 17 11:24:35 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 399/1168] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:24:35 2023] GET /compute/v2.1/servers/4368205b-a69c-49cd-958f-8f193856466a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 11:24:35 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-f891e013-f0f1-494e-85ec-1514e34f12ca tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:24:35 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-f891e013-f0f1-494e-85ec-1514e34f12ca tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:24:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f891e013-f0f1-494e-85ec-1514e34f12ca tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:24:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f891e013-f0f1-494e-85ec-1514e34f12ca tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:24:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f891e013-f0f1-494e-85ec-1514e34f12ca tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:24:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f891e013-f0f1-494e-85ec-1514e34f12ca tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:24:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f891e013-f0f1-494e-85ec-1514e34f12ca tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:24:35 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-f891e013-f0f1-494e-85ec-1514e34f12ca tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:24:35 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-f891e013-f0f1-494e-85ec-1514e34f12ca tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] HTTP exception thrown: Instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 could not be found. Apr 17 11:24:35 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-f891e013-f0f1-494e-85ec-1514e34f12ca tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Request method failure captured: Apr 17 11:24:35 user devstack@n-api.service[72743]: request: DELETE /compute/v2.1/servers/6c9d8d80-93ff-41f3-85c3-b2175b4532a9 HTTP/1.1 Apr 17 11:24:35 user devstack@n-api.service[72743]: Accept: application/json Apr 17 11:24:35 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 11:24:35 user devstack@n-api.service[72743]: Connection: close Apr 17 11:24:35 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 11:24:35 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 11:24:35 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 11:24:35 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 11:24:35 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 11:24:35 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSkdNQlCQC0j_Scqt663u25JTKQ0VvHFR-Bs1WS4w1fclhhIe3uhdCjhS0GOk8WnVkAutnR7qqfJWjiB6gcAQZ5DHL7aRU3t4toaBkIvfpzRhhQyd8nAqMW--pdlYU2PLeANHC09fvmgTb5gEfrAhofFPyP8HzlyOsNLSJt_SNIjKTc Apr 17 11:24:35 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 11:24:35 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 11:24:35 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 11:24:35 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 11:24:35 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 11:24:35 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 11:24:35 user devstack@n-api.service[72743]: X-Project-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:24:35 user devstack@n-api.service[72743]: X-Project-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:24:35 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 11:24:35 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 11:24:35 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:24:35 user devstack@n-api.service[72743]: X-Tenant: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:24:35 user devstack@n-api.service[72743]: X-Tenant-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:24:35 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:24:35 user devstack@n-api.service[72743]: X-User: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:24:35 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 11:24:35 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 11:24:35 user devstack@n-api.service[72743]: X-User-Id: 8fc272a75798487d84beedfa65775423 Apr 17 11:24:35 user devstack@n-api.service[72743]: X-User-Name: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:24:35 user devstack@n-api.service[72743]: method: > Apr 17 11:24:35 user devstack@n-api.service[72743]: exception: Instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 could not be found. Apr 17 11:24:35 user devstack@n-api.service[72743]: action_args: {'id': '6c9d8d80-93ff-41f3-85c3-b2175b4532a9'} Apr 17 11:24:35 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 could not be found. Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 could not be found. Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 could not be found. Apr 17 11:24:35 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:24:35 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-f891e013-f0f1-494e-85ec-1514e34f12ca tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Returning 404 to user: Instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:24:35 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-f891e013-f0f1-494e-85ec-1514e34f12ca tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6c9d8d80-93ff-41f3-85c3-b2175b4532a9" status: 404 len: 111 microversion: 2.1 time: 0.028105 Apr 17 11:24:35 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 392/1169] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 11:24:35 2023] DELETE /compute/v2.1/servers/6c9d8d80-93ff-41f3-85c3-b2175b4532a9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 11:24:35 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-61c210c5-af93-42cb-850e-c18578b146a0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:24:35 user devstack@n-api.service[72744]: DEBUG nova.compute.api [None req-61c210c5-af93-42cb-850e-c18578b146a0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 6c9d8d80-93ff-41f3-85c3-b2175b4532a9] Fetching instance by UUID {{(pid=72744) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:24:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-61c210c5-af93-42cb-850e-c18578b146a0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:24:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-61c210c5-af93-42cb-850e-c18578b146a0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:24:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-61c210c5-af93-42cb-850e-c18578b146a0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:24:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-61c210c5-af93-42cb-850e-c18578b146a0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:24:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-61c210c5-af93-42cb-850e-c18578b146a0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:24:35 user devstack@n-api.service[72744]: DEBUG oslo_concurrency.lockutils [None req-61c210c5-af93-42cb-850e-c18578b146a0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72744) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:24:35 user devstack@n-api.service[72744]: INFO nova.api.openstack.wsgi [None req-61c210c5-af93-42cb-850e-c18578b146a0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] HTTP exception thrown: Instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 could not be found. Apr 17 11:24:35 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-61c210c5-af93-42cb-850e-c18578b146a0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Request method failure captured: Apr 17 11:24:35 user devstack@n-api.service[72744]: request: GET /compute/v2.1/servers/6c9d8d80-93ff-41f3-85c3-b2175b4532a9 HTTP/1.1 Apr 17 11:24:35 user devstack@n-api.service[72744]: Accept: application/json Apr 17 11:24:35 user devstack@n-api.service[72744]: Accept-Encoding: identity Apr 17 11:24:35 user devstack@n-api.service[72744]: Connection: close Apr 17 11:24:35 user devstack@n-api.service[72744]: Content-Length: 0 Apr 17 11:24:35 user devstack@n-api.service[72744]: Content-Type: application/json Apr 17 11:24:35 user devstack@n-api.service[72744]: Host: 10.0.0.210 Apr 17 11:24:35 user devstack@n-api.service[72744]: Openstack-System-Scope: None Apr 17 11:24:35 user devstack@n-api.service[72744]: User-Agent: python-urllib3/1.26.15 Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Auth-Token: gAAAAABkPSkdNQlCQC0j_Scqt663u25JTKQ0VvHFR-Bs1WS4w1fclhhIe3uhdCjhS0GOk8WnVkAutnR7qqfJWjiB6gcAQZ5DHL7aRU3t4toaBkIvfpzRhhQyd8nAqMW--pdlYU2PLeANHC09fvmgTb5gEfrAhofFPyP8HzlyOsNLSJt_SNIjKTc Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Domain-Id: None Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Domain-Name: None Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Identity-Status: Confirmed Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Is-Admin-Project: True Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Project-Domain-Id: default Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Project-Domain-Name: Default Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Project-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Project-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Role: reader,member Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Roles: reader,member Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Tenant: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Tenant-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:24:35 user devstack@n-api.service[72744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:24:35 user devstack@n-api.service[72744]: X-User: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:24:35 user devstack@n-api.service[72744]: X-User-Domain-Id: default Apr 17 11:24:35 user devstack@n-api.service[72744]: X-User-Domain-Name: Default Apr 17 11:24:35 user devstack@n-api.service[72744]: X-User-Id: 8fc272a75798487d84beedfa65775423 Apr 17 11:24:35 user devstack@n-api.service[72744]: X-User-Name: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:24:35 user devstack@n-api.service[72744]: method: > Apr 17 11:24:35 user devstack@n-api.service[72744]: exception: Instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 could not be found. Apr 17 11:24:35 user devstack@n-api.service[72744]: action_args: {'id': '6c9d8d80-93ff-41f3-85c3-b2175b4532a9'} Apr 17 11:24:35 user devstack@n-api.service[72744]: {{(pid=72744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 could not be found. Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 could not be found. Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 could not be found. Apr 17 11:24:35 user devstack@n-api.service[72744]: ERROR nova.api.openstack.wsgi Apr 17 11:24:35 user devstack@n-api.service[72744]: DEBUG nova.api.openstack.wsgi [None req-61c210c5-af93-42cb-850e-c18578b146a0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Returning 404 to user: Instance 6c9d8d80-93ff-41f3-85c3-b2175b4532a9 could not be found. {{(pid=72744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:24:35 user devstack@n-api.service[72744]: INFO nova.api.openstack.requestlog [None req-61c210c5-af93-42cb-850e-c18578b146a0 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c9d8d80-93ff-41f3-85c3-b2175b4532a9" status: 404 len: 111 microversion: 2.1 time: 0.028195 Apr 17 11:24:35 user devstack@n-api.service[72744]: [pid: 72744|app: 0|req: 379/1170] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:24:35 2023] GET /compute/v2.1/servers/6c9d8d80-93ff-41f3-85c3-b2175b4532a9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 11:24:38 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-065c91fa-61fc-4c9f-8ddf-096d9574b368 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:24:38 user devstack@n-api.service[72745]: DEBUG nova.compute.api [None req-065c91fa-61fc-4c9f-8ddf-096d9574b368 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Fetching instance by UUID {{(pid=72745) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:24:38 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-065c91fa-61fc-4c9f-8ddf-096d9574b368 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:24:38 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-065c91fa-61fc-4c9f-8ddf-096d9574b368 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:24:38 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-065c91fa-61fc-4c9f-8ddf-096d9574b368 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:24:38 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-065c91fa-61fc-4c9f-8ddf-096d9574b368 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:24:38 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-065c91fa-61fc-4c9f-8ddf-096d9574b368 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:24:38 user devstack@n-api.service[72745]: DEBUG oslo_concurrency.lockutils [None req-065c91fa-61fc-4c9f-8ddf-096d9574b368 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72745) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:24:38 user devstack@n-api.service[72745]: INFO nova.api.openstack.wsgi [None req-065c91fa-61fc-4c9f-8ddf-096d9574b368 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] HTTP exception thrown: Instance 027f1645-6991-4726-b1f4-2728db710061 could not be found. Apr 17 11:24:38 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-065c91fa-61fc-4c9f-8ddf-096d9574b368 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Request method failure captured: Apr 17 11:24:38 user devstack@n-api.service[72745]: request: DELETE /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061 HTTP/1.1 Apr 17 11:24:38 user devstack@n-api.service[72745]: Accept: application/json Apr 17 11:24:38 user devstack@n-api.service[72745]: Accept-Encoding: identity Apr 17 11:24:38 user devstack@n-api.service[72745]: Connection: close Apr 17 11:24:38 user devstack@n-api.service[72745]: Content-Length: 0 Apr 17 11:24:38 user devstack@n-api.service[72745]: Content-Type: application/json Apr 17 11:24:38 user devstack@n-api.service[72745]: Host: 10.0.0.210 Apr 17 11:24:38 user devstack@n-api.service[72745]: Openstack-System-Scope: None Apr 17 11:24:38 user devstack@n-api.service[72745]: User-Agent: python-urllib3/1.26.15 Apr 17 11:24:38 user devstack@n-api.service[72745]: X-Auth-Token: gAAAAABkPSkdNQlCQC0j_Scqt663u25JTKQ0VvHFR-Bs1WS4w1fclhhIe3uhdCjhS0GOk8WnVkAutnR7qqfJWjiB6gcAQZ5DHL7aRU3t4toaBkIvfpzRhhQyd8nAqMW--pdlYU2PLeANHC09fvmgTb5gEfrAhofFPyP8HzlyOsNLSJt_SNIjKTc Apr 17 11:24:38 user devstack@n-api.service[72745]: X-Domain-Id: None Apr 17 11:24:38 user devstack@n-api.service[72745]: X-Domain-Name: None Apr 17 11:24:38 user devstack@n-api.service[72745]: X-Identity-Status: Confirmed Apr 17 11:24:38 user devstack@n-api.service[72745]: X-Is-Admin-Project: True Apr 17 11:24:38 user devstack@n-api.service[72745]: X-Project-Domain-Id: default Apr 17 11:24:38 user devstack@n-api.service[72745]: X-Project-Domain-Name: Default Apr 17 11:24:38 user devstack@n-api.service[72745]: X-Project-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:24:38 user devstack@n-api.service[72745]: X-Project-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:24:38 user devstack@n-api.service[72745]: X-Role: reader,member Apr 17 11:24:38 user devstack@n-api.service[72745]: X-Roles: reader,member Apr 17 11:24:38 user devstack@n-api.service[72745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:24:38 user devstack@n-api.service[72745]: X-Tenant: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:24:38 user devstack@n-api.service[72745]: X-Tenant-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:24:38 user devstack@n-api.service[72745]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:24:38 user devstack@n-api.service[72745]: X-User: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:24:38 user devstack@n-api.service[72745]: X-User-Domain-Id: default Apr 17 11:24:38 user devstack@n-api.service[72745]: X-User-Domain-Name: Default Apr 17 11:24:38 user devstack@n-api.service[72745]: X-User-Id: 8fc272a75798487d84beedfa65775423 Apr 17 11:24:38 user devstack@n-api.service[72745]: X-User-Name: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:24:38 user devstack@n-api.service[72745]: method: > Apr 17 11:24:38 user devstack@n-api.service[72745]: exception: Instance 027f1645-6991-4726-b1f4-2728db710061 could not be found. Apr 17 11:24:38 user devstack@n-api.service[72745]: action_args: {'id': '027f1645-6991-4726-b1f4-2728db710061'} Apr 17 11:24:38 user devstack@n-api.service[72745]: {{(pid=72745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 027f1645-6991-4726-b1f4-2728db710061 could not be found. Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 027f1645-6991-4726-b1f4-2728db710061 could not be found. Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 027f1645-6991-4726-b1f4-2728db710061 could not be found. Apr 17 11:24:38 user devstack@n-api.service[72745]: ERROR nova.api.openstack.wsgi Apr 17 11:24:38 user devstack@n-api.service[72745]: DEBUG nova.api.openstack.wsgi [None req-065c91fa-61fc-4c9f-8ddf-096d9574b368 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Returning 404 to user: Instance 027f1645-6991-4726-b1f4-2728db710061 could not be found. {{(pid=72745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:24:38 user devstack@n-api.service[72745]: INFO nova.api.openstack.requestlog [None req-065c91fa-61fc-4c9f-8ddf-096d9574b368 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061" status: 404 len: 111 microversion: 2.1 time: 0.029418 Apr 17 11:24:38 user devstack@n-api.service[72745]: [pid: 72745|app: 0|req: 400/1171] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 11:24:38 2023] DELETE /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 11:24:38 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-0cdba71e-0bc2-4df1-8256-987b007d7623 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Calling method '>' {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 11:24:38 user devstack@n-api.service[72743]: DEBUG nova.compute.api [None req-0cdba71e-0bc2-4df1-8256-987b007d7623 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] [instance: 027f1645-6991-4726-b1f4-2728db710061] Fetching instance by UUID {{(pid=72743) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 11:24:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-0cdba71e-0bc2-4df1-8256-987b007d7623 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:24:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-0cdba71e-0bc2-4df1-8256-987b007d7623 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:24:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-0cdba71e-0bc2-4df1-8256-987b007d7623 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:24:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-0cdba71e-0bc2-4df1-8256-987b007d7623 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Acquiring lock "ffc8026a-7976-4201-8419-273e745bfd05" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 11:24:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-0cdba71e-0bc2-4df1-8256-987b007d7623 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 11:24:38 user devstack@n-api.service[72743]: DEBUG oslo_concurrency.lockutils [None req-0cdba71e-0bc2-4df1-8256-987b007d7623 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Lock "ffc8026a-7976-4201-8419-273e745bfd05" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72743) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 11:24:38 user devstack@n-api.service[72743]: INFO nova.api.openstack.wsgi [None req-0cdba71e-0bc2-4df1-8256-987b007d7623 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] HTTP exception thrown: Instance 027f1645-6991-4726-b1f4-2728db710061 could not be found. Apr 17 11:24:38 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-0cdba71e-0bc2-4df1-8256-987b007d7623 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Request method failure captured: Apr 17 11:24:38 user devstack@n-api.service[72743]: request: GET /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061 HTTP/1.1 Apr 17 11:24:38 user devstack@n-api.service[72743]: Accept: application/json Apr 17 11:24:38 user devstack@n-api.service[72743]: Accept-Encoding: identity Apr 17 11:24:38 user devstack@n-api.service[72743]: Connection: close Apr 17 11:24:38 user devstack@n-api.service[72743]: Content-Length: 0 Apr 17 11:24:38 user devstack@n-api.service[72743]: Content-Type: application/json Apr 17 11:24:38 user devstack@n-api.service[72743]: Host: 10.0.0.210 Apr 17 11:24:38 user devstack@n-api.service[72743]: Openstack-System-Scope: None Apr 17 11:24:38 user devstack@n-api.service[72743]: User-Agent: python-urllib3/1.26.15 Apr 17 11:24:38 user devstack@n-api.service[72743]: X-Auth-Token: gAAAAABkPSkdNQlCQC0j_Scqt663u25JTKQ0VvHFR-Bs1WS4w1fclhhIe3uhdCjhS0GOk8WnVkAutnR7qqfJWjiB6gcAQZ5DHL7aRU3t4toaBkIvfpzRhhQyd8nAqMW--pdlYU2PLeANHC09fvmgTb5gEfrAhofFPyP8HzlyOsNLSJt_SNIjKTc Apr 17 11:24:38 user devstack@n-api.service[72743]: X-Domain-Id: None Apr 17 11:24:38 user devstack@n-api.service[72743]: X-Domain-Name: None Apr 17 11:24:38 user devstack@n-api.service[72743]: X-Identity-Status: Confirmed Apr 17 11:24:38 user devstack@n-api.service[72743]: X-Is-Admin-Project: True Apr 17 11:24:38 user devstack@n-api.service[72743]: X-Project-Domain-Id: default Apr 17 11:24:38 user devstack@n-api.service[72743]: X-Project-Domain-Name: Default Apr 17 11:24:38 user devstack@n-api.service[72743]: X-Project-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:24:38 user devstack@n-api.service[72743]: X-Project-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:24:38 user devstack@n-api.service[72743]: X-Role: reader,member Apr 17 11:24:38 user devstack@n-api.service[72743]: X-Roles: reader,member Apr 17 11:24:38 user devstack@n-api.service[72743]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/64eccc3b86914e4ab735b79c4b53a142"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 17 11:24:38 user devstack@n-api.service[72743]: X-Tenant: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:24:38 user devstack@n-api.service[72743]: X-Tenant-Id: 64eccc3b86914e4ab735b79c4b53a142 Apr 17 11:24:38 user devstack@n-api.service[72743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60160992 Apr 17 11:24:38 user devstack@n-api.service[72743]: X-User: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:24:38 user devstack@n-api.service[72743]: X-User-Domain-Id: default Apr 17 11:24:38 user devstack@n-api.service[72743]: X-User-Domain-Name: Default Apr 17 11:24:38 user devstack@n-api.service[72743]: X-User-Id: 8fc272a75798487d84beedfa65775423 Apr 17 11:24:38 user devstack@n-api.service[72743]: X-User-Name: tempest-AttachVolumeNegativeTest-60160992-project-member Apr 17 11:24:38 user devstack@n-api.service[72743]: method: > Apr 17 11:24:38 user devstack@n-api.service[72743]: exception: Instance 027f1645-6991-4726-b1f4-2728db710061 could not be found. Apr 17 11:24:38 user devstack@n-api.service[72743]: action_args: {'id': '027f1645-6991-4726-b1f4-2728db710061'} Apr 17 11:24:38 user devstack@n-api.service[72743]: {{(pid=72743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 027f1645-6991-4726-b1f4-2728db710061 could not be found. Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 027f1645-6991-4726-b1f4-2728db710061 could not be found. Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 027f1645-6991-4726-b1f4-2728db710061 could not be found. Apr 17 11:24:38 user devstack@n-api.service[72743]: ERROR nova.api.openstack.wsgi Apr 17 11:24:38 user devstack@n-api.service[72743]: DEBUG nova.api.openstack.wsgi [None req-0cdba71e-0bc2-4df1-8256-987b007d7623 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] Returning 404 to user: Instance 027f1645-6991-4726-b1f4-2728db710061 could not be found. {{(pid=72743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 11:24:38 user devstack@n-api.service[72743]: INFO nova.api.openstack.requestlog [None req-0cdba71e-0bc2-4df1-8256-987b007d7623 tempest-AttachVolumeNegativeTest-60160992 tempest-AttachVolumeNegativeTest-60160992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061" status: 404 len: 111 microversion: 2.1 time: 0.026956 Apr 17 11:24:38 user devstack@n-api.service[72743]: [pid: 72743|app: 0|req: 393/1172] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 11:24:38 2023] GET /compute/v2.1/servers/027f1645-6991-4726-b1f4-2728db710061 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)